We are using Dell 720 and 730xd servers for our Ceph OSD servers. Here is the process that we use in order to replace a disk and\/or remove the faulty OSD from service.<\/p>\n
In this example we will attempt to replace OSD #45 (slot #9 of this particular server):<\/p>\n
Stop the OSD and unmount the directory:<\/strong> If not already offline…offline the drive:<\/strong> NOW PHYSICALLY REPLACE THE BAD THE DRIVE WITH A NEW ONE.<\/strong><\/p>\n Set drive state to online if not already:<\/strong> You may need to discard the cache before doing the last step: <\/strong> Recreate OSD using Bluestore as the new default<\/strong> We are using Dell 720 and 730xd servers for our Ceph OSD servers. Here is the process that we use in order to replace a disk and\/or remove the faulty OSD from service. In this example we will attempt to replace OSD #45 (slot #9 of this particular server): Stop the OSD and unmount the […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[35,36,3],"tags":[],"_links":{"self":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1652"}],"collection":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/comments?post=1652"}],"version-history":[{"count":4,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1652\/revisions"}],"predecessor-version":[{"id":1689,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/posts\/1652\/revisions\/1689"}],"wp:attachment":[{"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/media?parent=1652"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/categories?post=1652"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.shainmiley.com\/wordpress\/wp-json\/wp\/v2\/tags?post=1652"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nstop ceph-osd id=45<\/code>
\numount \/var\/lib\/ceph\/osd\/ceph-45<\/code>
\nceph osd crush reweight osd.num 0.0<\/code> (wait for the cluster to rebalance):
\nceph osd out osd.num<\/code>
\nservice ceph stop osd.num<\/code>
\nceph osd crush remove osd.num<\/code>
\nceph auth del osd.num<\/code>
\nceph osd rm osd.num<\/code><\/p>\nmegacli -PDList -a0<\/code><\/p>\n
\nmegacli -pdoffline -physdrv[32:9] -a0<\/code>
\nMark disk as missing:<\/strong>
\nmegacli -pdmarkmissing -physdrv[32:9] -a0<\/code>
\nPermanently remove drive from array:<\/strong>
\nmegacli -pdprprmv -physdrv[32:9] -a0<\/code><\/p>\n
\nmegacli -PDOnline -PhysDrv [32:9] -a0<\/code>
\nCreate Raid-0 array on new drive:<\/strong>
\nmegacli -CfgLdAdd -r0[32:9] -a0<\/code><\/p>\n
\nFirst get cache lsit:<\/strong>
\nmegacli -GetPreservedCacheList -a0<\/code>
\nClear whichover one you need to:<\/strong>
\nmegacli -DiscardPreservedCache -L2 -a0<\/code><\/p>\n
\nceph-deploy disk zap hqosdNUM \/dev\/sdx<\/code>
\nceph-deploy osd create --data \/dev\/sdm hqosdNUM<\/code><\/p>\n","protected":false},"excerpt":{"rendered":"