After spending about 4 months testing, benchmarking, setting up and breaking down various Ceph clusters, I though I would spend time documenting some of the things I have learned while setting up cephfs, rbd and radosgw along the way.<\/p>\n
First let me talk a little bit about the details of the cluster that we will be putting into production over the next several weeks.<\/p>\n
Cluster specs:<\/strong><\/p>\n The process I used to set- up and tear down our cluster during testing was quite simple, after installing ‘ceph-deploy’ on the admin node:<\/p>\n The uninstall process went something like this:<\/strong><\/p>\n Additions to ceph.conf:<\/strong><\/p>\n Since we wanted to configure an appropriate journal size for our 10GigE network, mount xfs with\u00c2\u00a0appropriate options and configure radosgw, we added the following to our ceph.conf (after ‘ceph-deploy new but before ‘ceph-deploy install’:<\/p>\n [global] [client.radosgw.gateway] Benchmarking:<\/strong><\/p>\n I used the following commands to benchmark rados, rbd, cephfs, etc<\/p>\n \u00c2\u00a0Ceph blogs worth reading:<\/strong><\/p>\n http:\/\/ceph.com\/community\/blog\/<\/a> After spending about 4 months testing, benchmarking, setting up and breaking down various Ceph clusters, I though I would spend time documenting some of the things I have learned while setting up cephfs, rbd and radosgw along the way. First let me talk a little bit about the details of the cluster that we will […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[35,3,23,32],"tags":[],"_links":{"self":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1501"}],"collection":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/comments?post=1501"}],"version-history":[{"count":23,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1501\/revisions"}],"predecessor-version":[{"id":1530,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1501\/revisions\/1530"}],"wp:attachment":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/media?parent=1501"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/categories?post=1501"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/tags?post=1501"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\n
\n
\n……….<\/li>\n<\/ol>\n\n
\n……….<\/li>\n
\nosd_journal_size = 10240
\nosd_mount_options_xfs = “rw,noatime,nodiratime,logbsize=256k,logbufs=8,inode64”
\nosd_mkfs_options_xfs = “-f -i size=2048”<\/p>\n
\nhost = mon1
\nkeyring = \/etc\/ceph\/keyring.radosgw.gateway
\nrgw_socket_path = \/tmp\/radosgw.sock
\nlog_file = \/var\/log\/ceph\/radosgw.log
\nadmin_socket = \/var\/run\/ceph\/radosgw.asok
\nrgw_dns_name = yourdomain.com
\ndebug rgw = 20
\nrgw print continue = true
\nrgw should log = true
\nrgw enable usage log = true<\/p>\n\n
\nhttp:\/\/www.sebastien-han.fr\/blog\/<\/a>
\nhttp:\/\/dachary.org\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"