/usr/lib/python3/site-packages/ceph_deploy/cli.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
  import pkg_resources
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.1.0): /usr/bin/ceph-deploy mon create-initial
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  subcommand                    : create-initial
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf object at 0x7f457a86fc50>
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  func                          : <function mon at 0x7f457a892b90>
[ceph_deploy.cli][INFO  ]  keyrings                      : None
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-hosta ceph-hostb ceph-hostc
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-hosta ...
[ceph-hosta][DEBUG ] connected to host: ceph-hosta 
[ceph_deploy.mon][INFO  ] distro info: altlinux 11.2 11.2sisyphus_alpha
[ceph-hosta][DEBUG ] determining if provided host has same hostname in remote
[ceph-hosta][DEBUG ] deploying mon to ceph-hosta
[ceph-hosta][DEBUG ] remote hostname: ceph-hosta
[ceph-hosta][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-hosta/done
[ceph-hosta][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-hosta/done
[ceph-hosta][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-hosta.mon.keyring
[ceph-hosta][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-hosta --keyring /var/lib/ceph/tmp/ceph-ceph-hosta.mon.keyring --setuser 167 --setgroup 167
[ceph-hosta][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-hosta.mon.keyring
[ceph-hosta][INFO  ] Running command: systemctl enable ceph.target
[ceph-hosta][INFO  ] Running command: systemctl enable ceph-mon@ceph-hosta
[ceph-hosta][WARNING] Created symlink '/etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph-hosta.service' → '/usr/lib/systemd/system/ceph-mon@.service'.
[ceph-hosta][INFO  ] Running command: systemctl start ceph-mon@ceph-hosta
[ceph-hosta][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hosta.asok mon_status
[ceph-hosta][DEBUG ] ********************************************************************************
[ceph-hosta][DEBUG ] status for monitor: mon.ceph-hosta
[ceph-hosta][DEBUG ] {
[ceph-hosta][DEBUG ]   "election_epoch": 0,
[ceph-hosta][DEBUG ]   "extra_probe_peers": [
[ceph-hosta][DEBUG ]     {
[ceph-hosta][DEBUG ]       "addrvec": [
[ceph-hosta][DEBUG ]         {
[ceph-hosta][DEBUG ]           "addr": "10.88.11.43:3300",
[ceph-hosta][DEBUG ]           "nonce": 0,
[ceph-hosta][DEBUG ]           "type": "v2"
[ceph-hosta][DEBUG ]         },
[ceph-hosta][DEBUG ]         {
[ceph-hosta][DEBUG ]           "addr": "10.88.11.43:6789",
[ceph-hosta][DEBUG ]           "nonce": 0,
[ceph-hosta][DEBUG ]           "type": "v1"
[ceph-hosta][DEBUG ]         }
[ceph-hosta][DEBUG ]       ]
[ceph-hosta][DEBUG ]     },
[ceph-hosta][DEBUG ]     {
[ceph-hosta][DEBUG ]       "addrvec": [
[ceph-hosta][DEBUG ]         {
[ceph-hosta][DEBUG ]           "addr": "10.88.13.119:3300",
[ceph-hosta][DEBUG ]           "nonce": 0,
[ceph-hosta][DEBUG ]           "type": "v2"
[ceph-hosta][DEBUG ]         },
[ceph-hosta][DEBUG ]         {
[ceph-hosta][DEBUG ]           "addr": "10.88.13.119:6789",
[ceph-hosta][DEBUG ]           "nonce": 0,
[ceph-hosta][DEBUG ]           "type": "v1"
[ceph-hosta][DEBUG ]         }
[ceph-hosta][DEBUG ]       ]
[ceph-hosta][DEBUG ]     }
[ceph-hosta][DEBUG ]   ],
[ceph-hosta][DEBUG ]   "feature_map": {
[ceph-hosta][DEBUG ]     "mon": [
[ceph-hosta][DEBUG ]       {
[ceph-hosta][DEBUG ]         "features": "0x3f03cffffffdffff",
[ceph-hosta][DEBUG ]         "num": 1,
[ceph-hosta][DEBUG ]         "release": "squid"
[ceph-hosta][DEBUG ]       }
[ceph-hosta][DEBUG ]     ]
[ceph-hosta][DEBUG ]   },
[ceph-hosta][DEBUG ]   "features": {
[ceph-hosta][DEBUG ]     "quorum_con": "0",
[ceph-hosta][DEBUG ]     "quorum_mon": [],
[ceph-hosta][DEBUG ]     "required_con": "0",
[ceph-hosta][DEBUG ]     "required_mon": []
[ceph-hosta][DEBUG ]   },
[ceph-hosta][DEBUG ]   "monmap": {
[ceph-hosta][DEBUG ]     "auth_allowed_ciphers": [
[ceph-hosta][DEBUG ]       {
[ceph-hosta][DEBUG ]         "name": "aes256k",
[ceph-hosta][DEBUG ]         "value": 2
[ceph-hosta][DEBUG ]       }
[ceph-hosta][DEBUG ]     ],
[ceph-hosta][DEBUG ]     "auth_epoch": 0,
[ceph-hosta][DEBUG ]     "auth_preferred_cipher": {
[ceph-hosta][DEBUG ]       "name": "aes256k",
[ceph-hosta][DEBUG ]       "value": 2
[ceph-hosta][DEBUG ]     },
[ceph-hosta][DEBUG ]     "auth_service_cipher": {
[ceph-hosta][DEBUG ]       "name": "aes256k",
[ceph-hosta][DEBUG ]       "value": 2
[ceph-hosta][DEBUG ]     },
[ceph-hosta][DEBUG ]     "created": "2026-11-04T10:22:33.480567Z",
[ceph-hosta][DEBUG ]     "disallowed_leaders": "",
[ceph-hosta][DEBUG ]     "election_strategy": 1,
[ceph-hosta][DEBUG ]     "epoch": 0,
[ceph-hosta][DEBUG ]     "features": {
[ceph-hosta][DEBUG ]       "optional": [],
[ceph-hosta][DEBUG ]       "persistent": []
[ceph-hosta][DEBUG ]     },
[ceph-hosta][DEBUG ]     "fsid": "acd0b17d-948d-4b8f-ada5-ee157cde5911",
[ceph-hosta][DEBUG ]     "min_mon_release": 0,
[ceph-hosta][DEBUG ]     "min_mon_release_name": "unknown",
[ceph-hosta][DEBUG ]     "modified": "2026-11-04T10:22:33.480567Z",
[ceph-hosta][DEBUG ]     "mons": [
[ceph-hosta][DEBUG ]       {
[ceph-hosta][DEBUG ]         "addr": "10.88.15.123:6789/0",
[ceph-hosta][DEBUG ]         "crush_location": [],
[ceph-hosta][DEBUG ]         "name": "ceph-hosta",
[ceph-hosta][DEBUG ]         "priority": 0,
[ceph-hosta][DEBUG ]         "public_addr": "10.88.15.123:6789/0",
[ceph-hosta][DEBUG ]         "public_addrs": {
[ceph-hosta][DEBUG ]           "addrvec": [
[ceph-hosta][DEBUG ]             {
[ceph-hosta][DEBUG ]               "addr": "10.88.15.123:3300",
[ceph-hosta][DEBUG ]               "nonce": 0,
[ceph-hosta][DEBUG ]               "type": "v2"
[ceph-hosta][DEBUG ]             },
[ceph-hosta][DEBUG ]             {
[ceph-hosta][DEBUG ]               "addr": "10.88.15.123:6789",
[ceph-hosta][DEBUG ]               "nonce": 0,
[ceph-hosta][DEBUG ]               "type": "v1"
[ceph-hosta][DEBUG ]             }
[ceph-hosta][DEBUG ]           ]
[ceph-hosta][DEBUG ]         },
[ceph-hosta][DEBUG ]         "rank": 0,
[ceph-hosta][DEBUG ]         "time_added": "2026-11-04T13:22:33:480543+0300",
[ceph-hosta][DEBUG ]         "weight": 0
[ceph-hosta][DEBUG ]       },
[ceph-hosta][DEBUG ]       {
[ceph-hosta][DEBUG ]         "addr": "0.0.0.0:0/1",
[ceph-hosta][DEBUG ]         "crush_location": [],
[ceph-hosta][DEBUG ]         "name": "ceph-hostb",
[ceph-hosta][DEBUG ]         "priority": 0,
[ceph-hosta][DEBUG ]         "public_addr": "0.0.0.0:0/1",
[ceph-hosta][DEBUG ]         "public_addrs": {
[ceph-hosta][DEBUG ]           "addrvec": [
[ceph-hosta][DEBUG ]             {
[ceph-hosta][DEBUG ]               "addr": "0.0.0.0:0",
[ceph-hosta][DEBUG ]               "nonce": 1,
[ceph-hosta][DEBUG ]               "type": "v1"
[ceph-hosta][DEBUG ]             }
[ceph-hosta][DEBUG ]           ]
[ceph-hosta][DEBUG ]         },
[ceph-hosta][DEBUG ]         "rank": 1,
[ceph-hosta][DEBUG ]         "time_added": "2026-11-04T13:22:34:279057+0300",
[ceph-hosta][DEBUG ]         "weight": 0
[ceph-hosta][DEBUG ]       },
[ceph-hosta][DEBUG ]       {
[ceph-hosta][DEBUG ]         "addr": "0.0.0.0:0/2",
[ceph-hosta][DEBUG ]         "crush_location": [],
[ceph-hosta][DEBUG ]         "name": "ceph-hostc",
[ceph-hosta][DEBUG ]         "priority": 0,
[ceph-hosta][DEBUG ]         "public_addr": "0.0.0.0:0/2",
[ceph-hosta][DEBUG ]         "public_addrs": {
[ceph-hosta][DEBUG ]           "addrvec": [
[ceph-hosta][DEBUG ]             {
[ceph-hosta][DEBUG ]               "addr": "0.0.0.0:0",
[ceph-hosta][DEBUG ]               "nonce": 2,
[ceph-hosta][DEBUG ]               "type": "v1"
[ceph-hosta][DEBUG ]             }
[ceph-hosta][DEBUG ]           ]
[ceph-hosta][DEBUG ]         },
[ceph-hosta][DEBUG ]         "rank": 2,
[ceph-hosta][DEBUG ]         "time_added": "2026-11-04T13:22:34:279060+0300",
[ceph-hosta][DEBUG ]         "weight": 0
[ceph-hosta][DEBUG ]       }
[ceph-hosta][DEBUG ]     ],
[ceph-hosta][DEBUG ]     "removed_ranks": "0",
[ceph-hosta][DEBUG ]     "stretch_mode": false,
[ceph-hosta][DEBUG ]     "tiebreaker_mon": ""
[ceph-hosta][DEBUG ]   },
[ceph-hosta][DEBUG ]   "name": "ceph-hosta",
[ceph-hosta][DEBUG ]   "outside_quorum": [
[ceph-hosta][DEBUG ]     "ceph-hosta"
[ceph-hosta][DEBUG ]   ],
[ceph-hosta][DEBUG ]   "quorum": [],
[ceph-hosta][DEBUG ]   "rank": 0,
[ceph-hosta][DEBUG ]   "state": "probing",
[ceph-hosta][DEBUG ]   "stretch_mode": false,
[ceph-hosta][DEBUG ]   "sync_provider": [],
[ceph-hosta][DEBUG ]   "uptime": 2411
[ceph-hosta][DEBUG ] }
[ceph-hosta][DEBUG ] ********************************************************************************
[ceph-hosta][INFO  ] monitor: mon.ceph-hosta is running
[ceph-hosta][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hosta.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-hostb ...
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
[ceph-hostb][DEBUG ] connected to host: ceph-hostb 
[ceph_deploy.mon][INFO  ] distro info: altlinux 11.2 11.2sisyphus_alpha
[ceph-hostb][DEBUG ] determining if provided host has same hostname in remote
[ceph-hostb][DEBUG ] deploying mon to ceph-hostb
[ceph-hostb][DEBUG ] remote hostname: ceph-hostb
[ceph-hostb][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-hostb/done
[ceph-hostb][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-hostb/done
[ceph-hostb][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-hostb.mon.keyring
[ceph-hostb][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-hostb --keyring /var/lib/ceph/tmp/ceph-ceph-hostb.mon.keyring --setuser 167 --setgroup 167
[ceph-hostb][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-hostb.mon.keyring
[ceph-hostb][INFO  ] Running command: systemctl enable ceph.target
[ceph-hostb][INFO  ] Running command: systemctl enable ceph-mon@ceph-hostb
[ceph-hostb][WARNING] Created symlink '/etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph-hostb.service' → '/usr/lib/systemd/system/ceph-mon@.service'.
[ceph-hostb][INFO  ] Running command: systemctl start ceph-mon@ceph-hostb
[ceph-hostb][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostb.asok mon_status
[ceph-hostb][DEBUG ] ********************************************************************************
[ceph-hostb][DEBUG ] status for monitor: mon.ceph-hostb
[ceph-hostb][DEBUG ] {
[ceph-hostb][DEBUG ]   "election_epoch": 1,
[ceph-hostb][DEBUG ]   "extra_probe_peers": [
[ceph-hostb][DEBUG ]     {
[ceph-hostb][DEBUG ]       "addrvec": [
[ceph-hostb][DEBUG ]         {
[ceph-hostb][DEBUG ]           "addr": "10.88.11.43:3300",
[ceph-hostb][DEBUG ]           "nonce": 0,
[ceph-hostb][DEBUG ]           "type": "v2"
[ceph-hostb][DEBUG ]         },
[ceph-hostb][DEBUG ]         {
[ceph-hostb][DEBUG ]           "addr": "10.88.11.43:6789",
[ceph-hostb][DEBUG ]           "nonce": 0,
[ceph-hostb][DEBUG ]           "type": "v1"
[ceph-hostb][DEBUG ]         }
[ceph-hostb][DEBUG ]       ]
[ceph-hostb][DEBUG ]     },
[ceph-hostb][DEBUG ]     {
[ceph-hostb][DEBUG ]       "addrvec": [
[ceph-hostb][DEBUG ]         {
[ceph-hostb][DEBUG ]           "addr": "10.88.15.123:3300",
[ceph-hostb][DEBUG ]           "nonce": 0,
[ceph-hostb][DEBUG ]           "type": "v2"
[ceph-hostb][DEBUG ]         },
[ceph-hostb][DEBUG ]         {
[ceph-hostb][DEBUG ]           "addr": "10.88.15.123:6789",
[ceph-hostb][DEBUG ]           "nonce": 0,
[ceph-hostb][DEBUG ]           "type": "v1"
[ceph-hostb][DEBUG ]         }
[ceph-hostb][DEBUG ]       ]
[ceph-hostb][DEBUG ]     }
[ceph-hostb][DEBUG ]   ],
[ceph-hostb][DEBUG ]   "feature_map": {
[ceph-hostb][DEBUG ]     "mon": [
[ceph-hostb][DEBUG ]       {
[ceph-hostb][DEBUG ]         "features": "0x3f03cffffffdffff",
[ceph-hostb][DEBUG ]         "num": 1,
[ceph-hostb][DEBUG ]         "release": "squid"
[ceph-hostb][DEBUG ]       }
[ceph-hostb][DEBUG ]     ]
[ceph-hostb][DEBUG ]   },
[ceph-hostb][DEBUG ]   "features": {
[ceph-hostb][DEBUG ]     "quorum_con": "0",
[ceph-hostb][DEBUG ]     "quorum_mon": [],
[ceph-hostb][DEBUG ]     "required_con": "0",
[ceph-hostb][DEBUG ]     "required_mon": []
[ceph-hostb][DEBUG ]   },
[ceph-hostb][DEBUG ]   "monmap": {
[ceph-hostb][DEBUG ]     "auth_allowed_ciphers": [
[ceph-hostb][DEBUG ]       {
[ceph-hostb][DEBUG ]         "name": "aes256k",
[ceph-hostb][DEBUG ]         "value": 2
[ceph-hostb][DEBUG ]       }
[ceph-hostb][DEBUG ]     ],
[ceph-hostb][DEBUG ]     "auth_epoch": 0,
[ceph-hostb][DEBUG ]     "auth_preferred_cipher": {
[ceph-hostb][DEBUG ]       "name": "aes256k",
[ceph-hostb][DEBUG ]       "value": 2
[ceph-hostb][DEBUG ]     },
[ceph-hostb][DEBUG ]     "auth_service_cipher": {
[ceph-hostb][DEBUG ]       "name": "aes256k",
[ceph-hostb][DEBUG ]       "value": 2
[ceph-hostb][DEBUG ]     },
[ceph-hostb][DEBUG ]     "created": "2026-11-04T10:22:37.734668Z",
[ceph-hostb][DEBUG ]     "disallowed_leaders": "",
[ceph-hostb][DEBUG ]     "election_strategy": 1,
[ceph-hostb][DEBUG ]     "epoch": 0,
[ceph-hostb][DEBUG ]     "features": {
[ceph-hostb][DEBUG ]       "optional": [],
[ceph-hostb][DEBUG ]       "persistent": []
[ceph-hostb][DEBUG ]     },
[ceph-hostb][DEBUG ]     "fsid": "acd0b17d-948d-4b8f-ada5-ee157cde5911",
[ceph-hostb][DEBUG ]     "min_mon_release": 0,
[ceph-hostb][DEBUG ]     "min_mon_release_name": "unknown",
[ceph-hostb][DEBUG ]     "modified": "2026-11-04T10:22:37.734668Z",
[ceph-hostb][DEBUG ]     "mons": [
[ceph-hostb][DEBUG ]       {
[ceph-hostb][DEBUG ]         "addr": "10.88.13.119:6789/0",
[ceph-hostb][DEBUG ]         "crush_location": [],
[ceph-hostb][DEBUG ]         "name": "ceph-hostb",
[ceph-hostb][DEBUG ]         "priority": 0,
[ceph-hostb][DEBUG ]         "public_addr": "10.88.13.119:6789/0",
[ceph-hostb][DEBUG ]         "public_addrs": {
[ceph-hostb][DEBUG ]           "addrvec": [
[ceph-hostb][DEBUG ]             {
[ceph-hostb][DEBUG ]               "addr": "10.88.13.119:3300",
[ceph-hostb][DEBUG ]               "nonce": 0,
[ceph-hostb][DEBUG ]               "type": "v2"
[ceph-hostb][DEBUG ]             },
[ceph-hostb][DEBUG ]             {
[ceph-hostb][DEBUG ]               "addr": "10.88.13.119:6789",
[ceph-hostb][DEBUG ]               "nonce": 0,
[ceph-hostb][DEBUG ]               "type": "v1"
[ceph-hostb][DEBUG ]             }
[ceph-hostb][DEBUG ]           ]
[ceph-hostb][DEBUG ]         },
[ceph-hostb][DEBUG ]         "rank": 0,
[ceph-hostb][DEBUG ]         "time_added": "2026-11-04T13:22:37:734660+0300",
[ceph-hostb][DEBUG ]         "weight": 0
[ceph-hostb][DEBUG ]       },
[ceph-hostb][DEBUG ]       {
[ceph-hostb][DEBUG ]         "addr": "10.88.15.123:6789/0",
[ceph-hostb][DEBUG ]         "crush_location": [],
[ceph-hostb][DEBUG ]         "name": "ceph-hosta",
[ceph-hostb][DEBUG ]         "priority": 0,
[ceph-hostb][DEBUG ]         "public_addr": "10.88.15.123:6789/0",
[ceph-hostb][DEBUG ]         "public_addrs": {
[ceph-hostb][DEBUG ]           "addrvec": [
[ceph-hostb][DEBUG ]             {
[ceph-hostb][DEBUG ]               "addr": "10.88.15.123:3300",
[ceph-hostb][DEBUG ]               "nonce": 0,
[ceph-hostb][DEBUG ]               "type": "v2"
[ceph-hostb][DEBUG ]             },
[ceph-hostb][DEBUG ]             {
[ceph-hostb][DEBUG ]               "addr": "10.88.15.123:6789",
[ceph-hostb][DEBUG ]               "nonce": 0,
[ceph-hostb][DEBUG ]               "type": "v1"
[ceph-hostb][DEBUG ]             }
[ceph-hostb][DEBUG ]           ]
[ceph-hostb][DEBUG ]         },
[ceph-hostb][DEBUG ]         "rank": 1,
[ceph-hostb][DEBUG ]         "time_added": "2026-11-04T13:22:38:362020+0300",
[ceph-hostb][DEBUG ]         "weight": 0
[ceph-hostb][DEBUG ]       },
[ceph-hostb][DEBUG ]       {
[ceph-hostb][DEBUG ]         "addr": "0.0.0.0:0/2",
[ceph-hostb][DEBUG ]         "crush_location": [],
[ceph-hostb][DEBUG ]         "name": "ceph-hostc",
[ceph-hostb][DEBUG ]         "priority": 0,
[ceph-hostb][DEBUG ]         "public_addr": "0.0.0.0:0/2",
[ceph-hostb][DEBUG ]         "public_addrs": {
[ceph-hostb][DEBUG ]           "addrvec": [
[ceph-hostb][DEBUG ]             {
[ceph-hostb][DEBUG ]               "addr": "0.0.0.0:0",
[ceph-hostb][DEBUG ]               "nonce": 2,
[ceph-hostb][DEBUG ]               "type": "v1"
[ceph-hostb][DEBUG ]             }
[ceph-hostb][DEBUG ]           ]
[ceph-hostb][DEBUG ]         },
[ceph-hostb][DEBUG ]         "rank": 2,
[ceph-hostb][DEBUG ]         "time_added": "2026-11-04T13:22:38:362023+0300",
[ceph-hostb][DEBUG ]         "weight": 0
[ceph-hostb][DEBUG ]       }
[ceph-hostb][DEBUG ]     ],
[ceph-hostb][DEBUG ]     "removed_ranks": "0,1",
[ceph-hostb][DEBUG ]     "stretch_mode": false,
[ceph-hostb][DEBUG ]     "tiebreaker_mon": ""
[ceph-hostb][DEBUG ]   },
[ceph-hostb][DEBUG ]   "name": "ceph-hostb",
[ceph-hostb][DEBUG ]   "outside_quorum": [],
[ceph-hostb][DEBUG ]   "quorum": [],
[ceph-hostb][DEBUG ]   "rank": 0,
[ceph-hostb][DEBUG ]   "state": "electing",
[ceph-hostb][DEBUG ]   "stretch_mode": false,
[ceph-hostb][DEBUG ]   "sync_provider": [],
[ceph-hostb][DEBUG ]   "uptime": 2950
[ceph-hostb][DEBUG ] }
[ceph-hostb][DEBUG ] ********************************************************************************
[ceph-hostb][INFO  ] monitor: mon.ceph-hostb is running
[ceph-hostb][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostb.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-hostc ...
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
[ceph-hostc][DEBUG ] connected to host: ceph-hostc 
[ceph_deploy.mon][INFO  ] distro info: altlinux 11.2 11.2sisyphus_alpha
[ceph-hostc][DEBUG ] determining if provided host has same hostname in remote
[ceph-hostc][DEBUG ] deploying mon to ceph-hostc
[ceph-hostc][DEBUG ] remote hostname: ceph-hostc
[ceph-hostc][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-hostc/done
[ceph-hostc][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-hostc/done
[ceph-hostc][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-hostc.mon.keyring
[ceph-hostc][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-hostc --keyring /var/lib/ceph/tmp/ceph-ceph-hostc.mon.keyring --setuser 167 --setgroup 167
[ceph-hostc][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-hostc.mon.keyring
[ceph-hostc][INFO  ] Running command: systemctl enable ceph.target
[ceph-hostc][INFO  ] Running command: systemctl enable ceph-mon@ceph-hostc
[ceph-hostc][WARNING] Created symlink '/etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph-hostc.service' → '/usr/lib/systemd/system/ceph-mon@.service'.
[ceph-hostc][INFO  ] Running command: systemctl start ceph-mon@ceph-hostc
[ceph-hostc][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostc.asok mon_status
[ceph-hostc][DEBUG ] ********************************************************************************
[ceph-hostc][DEBUG ] status for monitor: mon.ceph-hostc
[ceph-hostc][DEBUG ] {
[ceph-hostc][DEBUG ]   "election_epoch": 4,
[ceph-hostc][DEBUG ]   "extra_probe_peers": [
[ceph-hostc][DEBUG ]     {
[ceph-hostc][DEBUG ]       "addrvec": [
[ceph-hostc][DEBUG ]         {
[ceph-hostc][DEBUG ]           "addr": "10.88.13.119:3300",
[ceph-hostc][DEBUG ]           "nonce": 0,
[ceph-hostc][DEBUG ]           "type": "v2"
[ceph-hostc][DEBUG ]         },
[ceph-hostc][DEBUG ]         {
[ceph-hostc][DEBUG ]           "addr": "10.88.13.119:6789",
[ceph-hostc][DEBUG ]           "nonce": 0,
[ceph-hostc][DEBUG ]           "type": "v1"
[ceph-hostc][DEBUG ]         }
[ceph-hostc][DEBUG ]       ]
[ceph-hostc][DEBUG ]     },
[ceph-hostc][DEBUG ]     {
[ceph-hostc][DEBUG ]       "addrvec": [
[ceph-hostc][DEBUG ]         {
[ceph-hostc][DEBUG ]           "addr": "10.88.15.123:3300",
[ceph-hostc][DEBUG ]           "nonce": 0,
[ceph-hostc][DEBUG ]           "type": "v2"
[ceph-hostc][DEBUG ]         },
[ceph-hostc][DEBUG ]         {
[ceph-hostc][DEBUG ]           "addr": "10.88.15.123:6789",
[ceph-hostc][DEBUG ]           "nonce": 0,
[ceph-hostc][DEBUG ]           "type": "v1"
[ceph-hostc][DEBUG ]         }
[ceph-hostc][DEBUG ]       ]
[ceph-hostc][DEBUG ]     }
[ceph-hostc][DEBUG ]   ],
[ceph-hostc][DEBUG ]   "feature_map": {
[ceph-hostc][DEBUG ]     "mon": [
[ceph-hostc][DEBUG ]       {
[ceph-hostc][DEBUG ]         "features": "0x3f03cffffffdffff",
[ceph-hostc][DEBUG ]         "num": 1,
[ceph-hostc][DEBUG ]         "release": "squid"
[ceph-hostc][DEBUG ]       }
[ceph-hostc][DEBUG ]     ]
[ceph-hostc][DEBUG ]   },
[ceph-hostc][DEBUG ]   "features": {
[ceph-hostc][DEBUG ]     "quorum_con": "4540701547738038271",
[ceph-hostc][DEBUG ]     "quorum_mon": [
[ceph-hostc][DEBUG ]       "kraken",
[ceph-hostc][DEBUG ]       "luminous",
[ceph-hostc][DEBUG ]       "mimic",
[ceph-hostc][DEBUG ]       "osdmap-prune",
[ceph-hostc][DEBUG ]       "nautilus",
[ceph-hostc][DEBUG ]       "octopus",
[ceph-hostc][DEBUG ]       "pacific",
[ceph-hostc][DEBUG ]       "elector-pinging",
[ceph-hostc][DEBUG ]       "quincy",
[ceph-hostc][DEBUG ]       "reef",
[ceph-hostc][DEBUG ]       "squid",
[ceph-hostc][DEBUG ]       "cephx_auth_aes256k"
[ceph-hostc][DEBUG ]     ],
[ceph-hostc][DEBUG ]     "required_con": "2450521708007866372",
[ceph-hostc][DEBUG ]     "required_mon": [
[ceph-hostc][DEBUG ]       "kraken",
[ceph-hostc][DEBUG ]       "luminous",
[ceph-hostc][DEBUG ]       "mimic",
[ceph-hostc][DEBUG ]       "osdmap-prune",
[ceph-hostc][DEBUG ]       "nautilus",
[ceph-hostc][DEBUG ]       "octopus",
[ceph-hostc][DEBUG ]       "pacific",
[ceph-hostc][DEBUG ]       "elector-pinging",
[ceph-hostc][DEBUG ]       "quincy",
[ceph-hostc][DEBUG ]       "reef",
[ceph-hostc][DEBUG ]       "squid",
[ceph-hostc][DEBUG ]       "cephx_auth_aes256k"
[ceph-hostc][DEBUG ]     ]
[ceph-hostc][DEBUG ]   },
[ceph-hostc][DEBUG ]   "monmap": {
[ceph-hostc][DEBUG ]     "auth_allowed_ciphers": [
[ceph-hostc][DEBUG ]       {
[ceph-hostc][DEBUG ]         "name": "aes256k",
[ceph-hostc][DEBUG ]         "value": 2
[ceph-hostc][DEBUG ]       }
[ceph-hostc][DEBUG ]     ],
[ceph-hostc][DEBUG ]     "auth_epoch": 0,
[ceph-hostc][DEBUG ]     "auth_preferred_cipher": {
[ceph-hostc][DEBUG ]       "name": "aes256k",
[ceph-hostc][DEBUG ]       "value": 2
[ceph-hostc][DEBUG ]     },
[ceph-hostc][DEBUG ]     "auth_service_cipher": {
[ceph-hostc][DEBUG ]       "name": "aes256k",
[ceph-hostc][DEBUG ]       "value": 2
[ceph-hostc][DEBUG ]     },
[ceph-hostc][DEBUG ]     "created": "2026-11-04T10:22:42.424597Z",
[ceph-hostc][DEBUG ]     "disallowed_leaders": "",
[ceph-hostc][DEBUG ]     "election_strategy": 1,
[ceph-hostc][DEBUG ]     "epoch": 1,
[ceph-hostc][DEBUG ]     "features": {
[ceph-hostc][DEBUG ]       "optional": [],
[ceph-hostc][DEBUG ]       "persistent": [
[ceph-hostc][DEBUG ]         "kraken",
[ceph-hostc][DEBUG ]         "luminous",
[ceph-hostc][DEBUG ]         "mimic",
[ceph-hostc][DEBUG ]         "osdmap-prune",
[ceph-hostc][DEBUG ]         "nautilus",
[ceph-hostc][DEBUG ]         "octopus",
[ceph-hostc][DEBUG ]         "pacific",
[ceph-hostc][DEBUG ]         "elector-pinging",
[ceph-hostc][DEBUG ]         "quincy",
[ceph-hostc][DEBUG ]         "reef",
[ceph-hostc][DEBUG ]         "squid",
[ceph-hostc][DEBUG ]         "cephx_auth_aes256k"
[ceph-hostc][DEBUG ]       ]
[ceph-hostc][DEBUG ]     },
[ceph-hostc][DEBUG ]     "fsid": "acd0b17d-948d-4b8f-ada5-ee157cde5911",
[ceph-hostc][DEBUG ]     "min_mon_release": 19,
[ceph-hostc][DEBUG ]     "min_mon_release_name": "squid",
[ceph-hostc][DEBUG ]     "modified": "2026-11-04T10:22:42.424597Z",
[ceph-hostc][DEBUG ]     "mons": [
[ceph-hostc][DEBUG ]       {
[ceph-hostc][DEBUG ]         "addr": "10.88.11.43:6789/0",
[ceph-hostc][DEBUG ]         "crush_location": [],
[ceph-hostc][DEBUG ]         "name": "ceph-hostc",
[ceph-hostc][DEBUG ]         "priority": 0,
[ceph-hostc][DEBUG ]         "public_addr": "10.88.11.43:6789/0",
[ceph-hostc][DEBUG ]         "public_addrs": {
[ceph-hostc][DEBUG ]           "addrvec": [
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.11.43:3300",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v2"
[ceph-hostc][DEBUG ]             },
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.11.43:6789",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v1"
[ceph-hostc][DEBUG ]             }
[ceph-hostc][DEBUG ]           ]
[ceph-hostc][DEBUG ]         },
[ceph-hostc][DEBUG ]         "rank": 0,
[ceph-hostc][DEBUG ]         "time_added": "2026-11-04T13:22:42:424594+0300",
[ceph-hostc][DEBUG ]         "weight": 0
[ceph-hostc][DEBUG ]       },
[ceph-hostc][DEBUG ]       {
[ceph-hostc][DEBUG ]         "addr": "10.88.13.119:6789/0",
[ceph-hostc][DEBUG ]         "crush_location": [],
[ceph-hostc][DEBUG ]         "name": "ceph-hostb",
[ceph-hostc][DEBUG ]         "priority": 0,
[ceph-hostc][DEBUG ]         "public_addr": "10.88.13.119:6789/0",
[ceph-hostc][DEBUG ]         "public_addrs": {
[ceph-hostc][DEBUG ]           "addrvec": [
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.13.119:3300",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v2"
[ceph-hostc][DEBUG ]             },
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.13.119:6789",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v1"
[ceph-hostc][DEBUG ]             }
[ceph-hostc][DEBUG ]           ]
[ceph-hostc][DEBUG ]         },
[ceph-hostc][DEBUG ]         "rank": 1,
[ceph-hostc][DEBUG ]         "time_added": "2026-11-04T13:22:43:066941+0300",
[ceph-hostc][DEBUG ]         "weight": 0
[ceph-hostc][DEBUG ]       },
[ceph-hostc][DEBUG ]       {
[ceph-hostc][DEBUG ]         "addr": "10.88.15.123:6789/0",
[ceph-hostc][DEBUG ]         "crush_location": [],
[ceph-hostc][DEBUG ]         "name": "ceph-hosta",
[ceph-hostc][DEBUG ]         "priority": 0,
[ceph-hostc][DEBUG ]         "public_addr": "10.88.15.123:6789/0",
[ceph-hostc][DEBUG ]         "public_addrs": {
[ceph-hostc][DEBUG ]           "addrvec": [
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.15.123:3300",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v2"
[ceph-hostc][DEBUG ]             },
[ceph-hostc][DEBUG ]             {
[ceph-hostc][DEBUG ]               "addr": "10.88.15.123:6789",
[ceph-hostc][DEBUG ]               "nonce": 0,
[ceph-hostc][DEBUG ]               "type": "v1"
[ceph-hostc][DEBUG ]             }
[ceph-hostc][DEBUG ]           ]
[ceph-hostc][DEBUG ]         },
[ceph-hostc][DEBUG ]         "rank": 2,
[ceph-hostc][DEBUG ]         "time_added": "2026-11-04T13:22:43:066931+0300",
[ceph-hostc][DEBUG ]         "weight": 0
[ceph-hostc][DEBUG ]       }
[ceph-hostc][DEBUG ]     ],
[ceph-hostc][DEBUG ]     "removed_ranks": "1",
[ceph-hostc][DEBUG ]     "stretch_mode": false,
[ceph-hostc][DEBUG ]     "tiebreaker_mon": ""
[ceph-hostc][DEBUG ]   },
[ceph-hostc][DEBUG ]   "name": "ceph-hostc",
[ceph-hostc][DEBUG ]   "outside_quorum": [],
[ceph-hostc][DEBUG ]   "quorum": [
[ceph-hostc][DEBUG ]     0,
[ceph-hostc][DEBUG ]     1,
[ceph-hostc][DEBUG ]     2
[ceph-hostc][DEBUG ]   ],
[ceph-hostc][DEBUG ]   "quorum_age": 0,
[ceph-hostc][DEBUG ]   "rank": 0,
[ceph-hostc][DEBUG ]   "state": "leader",
[ceph-hostc][DEBUG ]   "stretch_mode": false,
[ceph-hostc][DEBUG ]   "sync_provider": [],
[ceph-hostc][DEBUG ]   "uptime": 2366
[ceph-hostc][DEBUG ] }
[ceph-hostc][DEBUG ] ********************************************************************************
[ceph-hostc][INFO  ] monitor: mon.ceph-hostc is running
[ceph-hostc][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostc.asok mon_status
[ceph_deploy.mon][INFO  ] processing monitor mon.ceph-hosta
[ceph-hosta][DEBUG ] connected to host: ceph-hosta 
[ceph-hosta][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hosta.asok mon_status
[ceph_deploy.mon][INFO  ] mon.ceph-hosta monitor has reached quorum!
[ceph_deploy.mon][INFO  ] processing monitor mon.ceph-hostb
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
[ceph-hostb][DEBUG ] connected to host: ceph-hostb 
[ceph-hostb][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostb.asok mon_status
[ceph_deploy.mon][INFO  ] mon.ceph-hostb monitor has reached quorum!
[ceph_deploy.mon][INFO  ] processing monitor mon.ceph-hostc
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
[ceph-hostc][DEBUG ] connected to host: ceph-hostc 
[ceph-hostc][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-hostc.asok mon_status
[ceph_deploy.mon][INFO  ] mon.ceph-hostc monitor has reached quorum!
[ceph_deploy.mon][INFO  ] all initial monitors are running and have formed quorum
[ceph_deploy.mon][INFO  ] Running gatherkeys...
[ceph_deploy.gatherkeys][INFO  ] Storing keys in temp directory /root/tmp/tmpfzqhrdy_
[ceph-hosta][DEBUG ] connected to host: ceph-hosta 
[ceph-hosta][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph-hosta.asok mon_status
[ceph-hosta][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-hosta/keyring auth get client.admin
[ceph-hosta][ERROR ] "ceph auth get-or-create for keytype admin returned 13
[ceph-hosta][DEBUG ] 2026-11-04T13:22:49.927+0300 7f178ffff6c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hosta][DEBUG ] 2026-11-04T13:22:52.927+0300 7f178ffff6c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hosta][DEBUG ] 2026-11-04T13:22:52.928+0300 7f1794a166c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hosta][DEBUG ] [errno 13] RADOS permission denied (error connecting to the cluster)
[ceph-hosta][ERROR ] Failed to return 'admin' key from host ceph-hosta
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostb' (ED25519) to the list of known hosts.
[ceph-hostb][DEBUG ] connected to host: ceph-hostb 
[ceph-hostb][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph-hostb.asok mon_status
[ceph-hostb][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-hostb/keyring auth get client.admin
[ceph-hostb][ERROR ] "ceph auth get-or-create for keytype admin returned 13
[ceph-hostb][DEBUG ] 2026-11-04T13:22:53.803+0300 7f3c73fff6c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostb][DEBUG ] 2026-11-04T13:22:56.799+0300 7f3c73fff6c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostb][DEBUG ] 2026-11-04T13:22:56.800+0300 7f3c80dc36c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostb][DEBUG ] [errno 13] RADOS permission denied (error connecting to the cluster)
[ceph-hostb][ERROR ] Failed to return 'admin' key from host ceph-hostb
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
Warning: Permanently added 'ceph-hostc' (ED25519) to the list of known hosts.
[ceph-hostc][DEBUG ] connected to host: ceph-hostc 
[ceph-hostc][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph-hostc.asok mon_status
[ceph-hostc][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-hostc/keyring auth get client.admin
[ceph-hostc][ERROR ] "ceph auth get-or-create for keytype admin returned 13
[ceph-hostc][DEBUG ] 2026-11-04T13:22:59.693+0300 7f17e1fc36c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] 2026-11-04T13:23:02.691+0300 7f17e17c26c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] 2026-11-04T13:23:02.694+0300 7f17e1fc36c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] 2026-11-04T13:23:05.695+0300 7f17e27c46c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] 2026-11-04T13:23:05.697+0300 7f17e17c26c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] 2026-11-04T13:23:05.697+0300 7f17e1fc36c0 -1 monclient(hunting): handle_auth_bad_method failed to auth with my available methods: (13) Permission denied
[ceph-hostc][DEBUG ] [errno 13] RADOS permission denied (error connecting to the cluster)
[ceph-hostc][ERROR ] Failed to return 'admin' key from host ceph-hostc
[ceph_deploy.gatherkeys][ERROR ] Failed to connect to host:ceph-hosta, ceph-hostb, ceph-hostc
[ceph_deploy.gatherkeys][INFO  ] Destroy temp directory /root/tmp/tmpfzqhrdy_
[ceph_deploy][ERROR ] RuntimeError: Failed to connect any mon