2026/05/19 19:32:29 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota
2026-05-19 19:32:29.871957 I | rookcmd: starting Rook v1.14.2 with arguments '/usr/local/bin/rook ceph operator'
2026-05-19 19:32:29.871982 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO
2026-05-19 19:32:29.871984 I | cephcmd: starting Rook-Ceph operator
2026-05-19 19:32:30.001778 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)"
2026-05-19 19:32:30.012097 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var)
2026-05-19 19:32:30.012124 I | operator: watching all namespaces for Ceph CRs
2026-05-19 19:32:30.012243 I | operator: setting up schemes
2026-05-19 19:32:30.014527 I | operator: setting up the controller-runtime manager
2026-05-19 19:32:30.014925 I | ceph-cluster-controller: successfully started
2026-05-19 19:32:30.018186 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var)
2026-05-19 19:32:30.018201 I | ceph-cluster-controller: enabling hotplug orchestration
2026-05-19 19:32:30.018217 I | ceph-nodedaemon-controller: successfully started
2026-05-19 19:32:30.018230 I | ceph-block-pool-controller: successfully started
2026-05-19 19:32:30.018245 I | ceph-object-store-user-controller: successfully started
2026-05-19 19:32:30.018257 I | ceph-object-realm-controller: successfully started
2026-05-19 19:32:30.018273 I | ceph-object-zonegroup-controller: successfully started
2026-05-19 19:32:30.018283 I | ceph-object-zone-controller: successfully started
2026-05-19 19:32:30.018356 I | ceph-object-controller: successfully started
2026-05-19 19:32:30.018387 I | ceph-file-controller: successfully started
2026-05-19 19:32:30.018407 I | ceph-nfs-controller: successfully started
2026-05-19 19:32:30.018426 I | ceph-rbd-mirror-controller: successfully started
2026-05-19 19:32:30.018451 I | ceph-client-controller: successfully started
2026-05-19 19:32:30.018464 I | ceph-filesystem-mirror-controller: successfully started
2026-05-19 19:32:30.018484 I | operator: rook-ceph-operator-config-controller successfully started
2026-05-19 19:32:30.018497 I | ceph-csi: rook-ceph-operator-csi-controller successfully started
2026-05-19 19:32:30.018567 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started
2026-05-19 19:32:30.018580 I | ceph-bucket-topic: successfully started
2026-05-19 19:32:30.018587 I | ceph-bucket-notification: successfully started
2026-05-19 19:32:30.018598 I | ceph-bucket-notification: successfully started
2026-05-19 19:32:30.018606 I | ceph-fs-subvolumegroup-controller: successfully started
2026-05-19 19:32:30.018615 I | blockpool-rados-namespace-controller: successfully started
2026-05-19 19:32:30.018622 I | ceph-cosi-controller: successfully started
2026-05-19 19:32:30.018641 I | operator: starting the controller-runtime manager
2026-05-19 19:32:30.157741 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default)
2026-05-19 19:32:30.222798 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap)
2026-05-19 19:32:30.223209 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap)
2026-05-19 19:32:30.223231 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap)
2026-05-19 19:32:30.223252 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap)
2026-05-19 19:32:30.225448 I | ceph-csi: CSI Ceph RBD driver disabled
2026-05-19 19:32:30.225487 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-05-19 19:32:30.227366 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap)
2026-05-19 19:32:30.227394 I | operator: rook-ceph-operator-config-controller done reconciling
2026-05-19 19:32:30.228144 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-05-19 19:32:30.236370 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-05-19 19:32:30.236388 I | ceph-csi: CSI CephFS driver disabled
2026-05-19 19:32:30.236393 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-05-19 19:32:30.239077 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-05-19 19:32:30.248215 I | ceph-csi: successfully removed CSI CephFS driver
2026-05-19 19:32:30.248237 I | ceph-csi: CSI NFS driver disabled
2026-05-19 19:32:30.248245 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-05-19 19:32:30.253000 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-05-19 19:32:30.268918 I | ceph-csi: successfully removed CSI NFS driver
2026-05-19 19:32:52.520568 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph"
2026-05-19 19:32:52.527143 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph"
2026-05-19 19:32:52.529112 I | clusterdisruption-controller: deleted all legacy node drain canary pods
2026-05-19 19:32:52.536994 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack"
2026-05-19 19:32:52.541787 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-05-19 19:32:52.544196 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:32:52.544211 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:32:52.544265 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap)
2026-05-19 19:32:52.544274 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default)
2026-05-19 19:32:52.544279 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket"
2026-05-19 19:32:52.544653 I | op-bucket-prov: successfully reconciled bucket provisioner
I0519 19:32:52.544734       1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket"
2026-05-19 19:32:52.545752 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-05-19 19:32:52.537114297 +0000 UTC m=+22.698428629 LastTransitionTime:2026-05-19 19:32:52.537114207 +0000 UTC m=+22.698428539}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again
2026-05-19 19:32:52.553162 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:32:52.553192 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:32:52.554308 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc0015a8690]
2026-05-19 19:32:52.554350 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1...
2026-05-19 19:32:52.564352 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap)
2026-05-19 19:32:52.564382 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap)
2026-05-19 19:32:53.124093 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:32:53.124132 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:32:53.323749 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap)
2026-05-19 19:32:53.323773 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap)
2026-05-19 19:32:53.323778 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap)
2026-05-19 19:32:53.323783 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default)
2026-05-19 19:32:53.323788 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap)
2026-05-19 19:32:53.323792 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap)
2026-05-19 19:32:53.323797 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default)
2026-05-19 19:32:53.323802 I | op-k8sutil: CSIADDONS_PORT="9070" (default)
2026-05-19 19:32:53.323806 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default)
2026-05-19 19:32:53.323810 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default)
2026-05-19 19:32:53.323814 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap)
2026-05-19 19:32:53.323819 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap)
2026-05-19 19:32:53.323827 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap)
2026-05-19 19:32:53.323833 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap)
2026-05-19 19:32:53.323871 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap)
2026-05-19 19:32:53.323875 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap)
2026-05-19 19:32:53.326569 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap)
2026-05-19 19:32:53.326580 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap)
2026-05-19 19:32:53.326584 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap)
2026-05-19 19:32:53.326587 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap)
2026-05-19 19:32:53.326591 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-05-19 19:32:53.326595 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default)
2026-05-19 19:32:53.326600 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-05-19 19:32:53.326604 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-05-19 19:32:53.326607 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default)
2026-05-19 19:32:53.326611 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap)
2026-05-19 19:32:53.326614 I | ceph-csi: Kubernetes version is 1.28
2026-05-19 19:32:53.326617 I | op-k8sutil: CSI_LOG_LEVEL="" (default)
2026-05-19 19:32:53.326621 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default)
2026-05-19 19:32:53.326624 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default)
2026-05-19 19:32:53.326628 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default)
2026-05-19 19:32:53.326631 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default)
2026-05-19 19:32:53.765810 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap)
2026-05-19 19:32:53.765863 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0" (configmap)
2026-05-19 19:32:53.765873 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.0" (configmap)
2026-05-19 19:32:53.765882 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.0" (configmap)
2026-05-19 19:32:53.765889 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.1" (configmap)
2026-05-19 19:32:53.765907 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.0" (configmap)
2026-05-19 19:32:53.765925 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default)
2026-05-19 19:32:53.765937 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap)
2026-05-19 19:32:53.765951 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default)
2026-05-19 19:32:53.765965 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default)
2026-05-19 19:32:53.766156 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default)
2026-05-19 19:32:53.766173 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default)
2026-05-19 19:32:53.766181 I | op-k8sutil: CSI_CLUSTER_NAME="" (default)
2026-05-19 19:32:53.766190 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap)
2026-05-19 19:32:53.766197 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default)
2026-05-19 19:32:53.766210 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap)
2026-05-19 19:32:53.766218 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap)
2026-05-19 19:32:53.766231 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap)
2026-05-19 19:32:53.766238 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default)
2026-05-19 19:32:53.769901 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap)
2026-05-19 19:32:53.769965 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled
2026-05-19 19:32:53.770061 I | ceph-csi: CSI Ceph RBD driver disabled
2026-05-19 19:32:53.770089 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-05-19 19:32:53.776577 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-05-19 19:32:53.782969 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-05-19 19:32:53.783023 I | ceph-csi: CSI CephFS driver disabled
2026-05-19 19:32:53.783045 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-05-19 19:32:53.785029 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-05-19 19:32:53.926550 I | ceph-csi: successfully removed CSI CephFS driver
2026-05-19 19:32:53.926779 I | ceph-csi: CSI NFS driver disabled
2026-05-19 19:32:53.926831 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-05-19 19:32:53.930154 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-05-19 19:32:54.128837 I | ceph-csi: successfully removed CSI NFS driver
2026-05-19 19:33:10.142478 I | ceph-spec: detected ceph image version: "18.2.1-0 reef"
2026-05-19 19:33:10.142506 I | ceph-cluster-controller: validating ceph version from provided image
2026-05-19 19:33:10.149797 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:33:10.149834 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:33:10.156463 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config
2026-05-19 19:33:10.156663 I | cephclient: generated admin config in /var/lib/rook/openstack
2026-05-19 19:33:10.739758 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 <unknown version>", consider upgrading
2026-05-19 19:33:11.347210 W | ceph-cluster-controller: image spec version 18.2.1-0 reef is lower than the running cluster version 18.2.7-0 reef, downgrading is not supported
2026-05-19 19:33:11.973486 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.1-0 reef"
2026-05-19 19:33:11.973542 I | ceph-cluster-controller: cluster "openstack": version "18.2.1-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1"
2026-05-19 19:33:12.784946 I | ceph-cluster-controller: creating "rook-config-override" configmap
2026-05-19 19:33:12.867007 I | ceph-cluster-controller: creating "rook-ceph-config" secret
2026-05-19 19:33:13.071174 I | ceph-cluster-controller: external cluster identity established
2026-05-19 19:33:13.071213 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner"
2026-05-19 19:33:14.021578 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings
2026-05-19 19:33:14.021618 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd
2026-05-19 19:33:14.726963 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:33:15.666218 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node"
2026-05-19 19:33:15.681847 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:33:17.026288 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:33:17.066856 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner"
2026-05-19 19:33:17.678531 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node"
2026-05-19 19:33:18.298840 I | ceph-csi: created kubernetes csi secrets for cluster "openstack"
2026-05-19 19:33:18.308921 I | ceph-cluster-controller: successfully updated csi config map
2026-05-19 19:33:18.308947 I | cephclient: getting or creating ceph auth key "client.crash"
2026-05-19 19:33:18.936943 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack"
2026-05-19 19:33:18.940993 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack"
2026-05-19 19:33:18.941037 I | ceph-cluster-controller: ceph status check interval is 1m0s
2026-05-19 19:33:18.941042 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack"
2026-05-19 19:33:22.886736 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:33:22.886761 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:33:22.886777 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1...
2026-05-19 19:33:25.310871 I | ceph-spec: detected ceph image version: "18.2.1-0 reef"
2026-05-19 19:33:26.840028 I | ceph-object-controller: reconciling object store deployments
2026-05-19 19:33:26.858965 I | ceph-object-controller: ceph object store gateway service running at 10.101.61.135
2026-05-19 19:33:26.859002 I | ceph-object-controller: reconciling object store pools
2026-05-19 19:33:29.790392 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-05-19 19:33:30.680448 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control"
2026-05-19 19:33:30.680488 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd"
2026-05-19 19:33:30.680496 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control"
2026-05-19 19:33:33.261739 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd"
2026-05-19 19:33:33.261780 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-05-19 19:33:39.341416 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-05-19 19:33:40.255575 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta"
2026-05-19 19:33:40.255612 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd"
2026-05-19 19:33:40.255619 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta"
2026-05-19 19:33:42.394194 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd"
2026-05-19 19:33:42.394241 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-05-19 19:33:45.961528 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:33:46.716303 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:33:48.504448 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-05-19 19:33:49.411142 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log"
2026-05-19 19:33:49.411178 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd"
2026-05-19 19:33:49.411187 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log"
2026-05-19 19:33:51.551467 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd"
2026-05-19 19:33:51.551503 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-05-19 19:33:55.630008 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-05-19 19:33:56.545783 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index"
2026-05-19 19:33:56.545825 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd"
2026-05-19 19:33:56.545834 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index"
2026-05-19 19:33:58.730813 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd"
2026-05-19 19:33:58.730846 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-05-19 19:34:02.810198 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-05-19 19:34:03.738088 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec"
2026-05-19 19:34:03.738120 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd"
2026-05-19 19:34:03.738126 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec"
2026-05-19 19:34:05.990597 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:34:06.879109 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd"
2026-05-19 19:34:06.879161 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-05-19 19:34:10.968996 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-05-19 19:34:11.919884 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp"
2026-05-19 19:34:11.919926 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd"
2026-05-19 19:34:11.919936 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp"
2026-05-19 19:34:13.987797 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd"
2026-05-19 19:34:13.987910 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-05-19 19:34:17.135284 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:34:18.276383 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:34:20.127814 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-05-19 19:34:22.141929 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root"
2026-05-19 19:34:22.141971 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd"
2026-05-19 19:34:22.141975 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root"
2026-05-19 19:34:25.580133 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd"
2026-05-19 19:34:25.580189 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-05-19 19:34:30.267987 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-05-19 19:34:31.200109 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data"
2026-05-19 19:34:31.200153 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd"
2026-05-19 19:34:31.200162 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data"
2026-05-19 19:34:33.324734 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd"
2026-05-19 19:34:33.324778 I | ceph-object-controller: configuring object store "ceph"
2026-05-19 19:34:34.012010 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph
2026-05-19 19:34:34.225383 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph"
2026-05-19 19:34:34.680595 I | ceph-object-controller: configuration for object-store ceph is complete
2026-05-19 19:34:34.680640 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-05-19 19:34:34.686199 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-05-19 19:34:35.311348 I | ceph-object-controller: setting rgw config flags
2026-05-19 19:34:35.311401 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-05-19 19:34:35.817858 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-05-19 19:34:35.817895 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-05-19 19:34:36.287485 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-05-19 19:34:36.287529 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-05-19 19:34:36.792025 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-05-19 19:34:36.792066 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-05-19 19:34:37.263726 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-05-19 19:34:37.263774 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database
2026-05-19 19:34:37.716506 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database
2026-05-19 19:34:37.716567 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-05-19 19:34:38.205366 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-05-19 19:34:38.205779 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-05-19 19:34:38.252596 I | ceph-object-controller: enabling rgw dashboard
2026-05-19 19:34:40.423572 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-05-19 19:34:40.424751 I | ceph-object-controller: setting the dashboard api secret key
2026-05-19 19:34:41.089200 I | ceph-object-controller: done setting the dashboard api secret key
2026-05-19 19:34:47.691803 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:34:48.861419 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:34:52.190686 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:35:10.920080 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.101.61.135:80: i/o timeout
2026-05-19 19:35:10.940374 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-05-19 19:35:10.940409 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-05-19 19:35:10.940427 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1...
2026-05-19 19:35:11.488914 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:94} {StateName:peering Count:17}]"
2026-05-19 19:35:11.497981 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:12.081026 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:94} {StateName:peering Count:17}]"
2026-05-19 19:35:12.084639 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:13.517988 I | ceph-spec: detected ceph image version: "18.2.1-0 reef"
2026-05-19 19:35:15.028430 I | ceph-object-controller: reconciling object store deployments
2026-05-19 19:35:15.063801 I | ceph-object-controller: ceph object store gateway service running at 10.101.61.135
2026-05-19 19:35:15.063841 I | ceph-object-controller: reconciling object store pools
2026-05-19 19:35:16.479065 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control"
2026-05-19 19:35:16.479096 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-05-19 19:35:17.446517 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-05-19 19:35:18.944248 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:20.254383 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:2} {StateName:active+clean+scrubbing Count:1}]"
2026-05-19 19:35:20.263318 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:20.846839 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta"
2026-05-19 19:35:20.846880 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-05-19 19:35:21.769437 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-05-19 19:35:24.832046 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log"
2026-05-19 19:35:24.832079 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-05-19 19:35:25.948810 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-05-19 19:35:28.829857 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index"
2026-05-19 19:35:28.829896 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-05-19 19:35:29.764130 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-05-19 19:35:31.873710 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec"
2026-05-19 19:35:31.873756 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-05-19 19:35:32.794240 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-05-19 19:35:34.946594 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp"
2026-05-19 19:35:34.946632 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-05-19 19:35:35.895222 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-05-19 19:35:38.904522 I | cephclient: application "rgw" is already set on pool ".rgw.root"
2026-05-19 19:35:38.904557 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-05-19 19:35:39.940983 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:35:40.418157 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-05-19 19:35:42.368865 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data"
2026-05-19 19:35:42.368899 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-05-19 19:35:43.323551 I | ceph-object-controller: configuring object store "ceph"
2026-05-19 19:35:43.584735 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph
2026-05-19 19:35:43.805804 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph"
2026-05-19 19:35:43.805842 I | ceph-object-controller: configuration for object-store ceph is complete
2026-05-19 19:35:43.805851 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-05-19 19:35:43.810830 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-05-19 19:35:44.381133 I | ceph-object-controller: setting rgw config flags
2026-05-19 19:35:44.381171 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-05-19 19:35:44.844170 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-05-19 19:35:44.844214 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-05-19 19:35:45.292189 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-05-19 19:35:45.292232 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-05-19 19:35:45.744253 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-05-19 19:35:45.744292 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-05-19 19:35:46.189783 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-05-19 19:35:46.189826 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database
2026-05-19 19:35:46.643629 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database
2026-05-19 19:35:46.643673 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-05-19 19:35:47.143095 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-05-19 19:35:47.143354 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-05-19 19:35:47.157409 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed
2026-05-19 19:35:47.168193 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update
2026-05-19 19:35:47.173023 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting
2026-05-19 19:35:47.177547 I | ceph-object-controller: enabling rgw dashboard
2026-05-19 19:35:48.336413 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-05-19 19:35:49.543322 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:50.226344 I | ceph-object-controller: creating COSI user "cosi"
2026-05-19 19:35:50.357130 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi"
2026-05-19 19:35:50.864536 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:35:51.459155 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:36:20.149578 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:36:21.432672 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:36:27.151931 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:36:50.706687 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:36:51.993432 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:37:13.322358 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:37:21.270405 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:37:22.579162 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:37:51.885477 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:37:53.142974 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:37:59.534514 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:38:22.493263 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:38:23.723120 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:38:45.730878 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:38:53.083656 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:38:54.320199 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:39:23.661303 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:39:24.881497 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:39:32.211289 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:39:54.257627 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:39:55.482578 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:40:18.397733 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:40:24.804982 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:40:26.057593 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:40:55.402841 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:40:56.638081 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:41:04.541079 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:41:25.972837 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:41:27.235785 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:41:50.699552 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:41:56.542088 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:41:57.816213 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:42:27.104506 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:42:28.385984 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:42:36.892617 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:42:57.693065 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:42:58.980350 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:43:23.042842 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:43:28.251832 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:43:29.545872 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:43:58.838144 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:44:00.111422 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:44:09.202084 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:44:29.409304 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:44:30.685665 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:44:55.399867 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:45:00.043784 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:45:01.260645 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:45:30.633305 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:45:31.831920 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:45:41.561104 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:46:01.225045 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:46:02.430903 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:46:27.748374 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:46:31.786171 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:46:33.042014 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:47:02.422446 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:47:03.605833 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:47:13.930135 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:47:33.046365 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:47:34.195368 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:48:00.063735 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:48:03.618609 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:48:04.782462 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:48:34.208296 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:48:35.371995 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:48:46.234907 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:49:04.766685 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:49:05.933823 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:49:32.364308 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:49:35.324565 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:49:36.517500 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:50:05.915819 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:50:07.080739 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:50:18.507364 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:50:36.469576 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:50:37.626089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:51:04.645968 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:51:07.025876 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:51:08.213575 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:51:37.606502 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:51:38.802669 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:51:50.851770 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:52:08.180053 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:52:09.370406 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:52:37.072914 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:52:38.786445 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:52:39.958014 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:53:09.380465 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:53:10.536015 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:53:23.288224 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:53:39.953789 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:53:41.097738 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:54:09.533846 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:54:10.546144 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:54:11.673167 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:54:41.158214 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:54:42.239654 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:54:55.730777 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:55:11.732412 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:55:12.837484 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:55:42.034933 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:55:42.462826 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:55:43.416193 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:56:13.035511 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:56:13.972911 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:56:28.183304 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:56:43.634529 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:56:44.539027 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:57:14.934103 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:57:15.120994 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:57:15.627752 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:57:45.522523 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:57:46.233028 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:58:01.273442 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:58:16.095747 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:58:16.821186 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:58:47.152771 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:58:48.358305 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:58:48.612372 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:59:17.742793 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:59:18.987353 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:59:34.759016 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 19:59:48.337181 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 19:59:49.562119 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:00:18.931262 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:00:20.564577 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:00:21.417767 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:00:49.519052 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:00:51.143027 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:01:07.605060 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:01:20.066708 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:01:21.722697 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:01:50.647489 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:01:52.331586 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:01:53.830912 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:02:21.215311 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:02:22.899767 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:02:39.956989 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:02:52.643433 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:02:53.459031 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:03:35.980222 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: etcdserver: request timed out
2026-05-19 20:04:14.102202 E | ceph-cluster-controller: failed to get ceph status. failed to get status. . timed out: exit status 1
2026-05-19 20:04:24.982998 E | ceph-cluster-controller: failed to retrieve ceph cluster "ceph" in namespace "openstack" to update status to &{Health:{Status:HEALTH_ERR Checks:map[error:{Severity:Urgent Summary:{Message:failed to get status. . timed out: exit status 1}}]} FSID: ElectionEpoch:0 Quorum:[] QuorumNames:[] MonMap:{Epoch:0 NumMons:0 FSID: CreatedTime: ModifiedTime: Mons:[]} OsdMap:{Epoch:0 NumOsd:0 NumUpOsd:0 NumInOsd:0 Full:false NearFull:false NumRemappedPgs:0} PgMap:{PgsByState:[] Version:0 NumPgs:0 DataBytes:0 UsedBytes:0 AvailableBytes:0 TotalBytes:0 ReadBps:0 WriteBps:0 ReadOps:0 WriteOps:0 RecoveryBps:0 RecoveryObjectsPerSec:0 RecoveryKeysPerSec:0 CacheFlushBps:0 CacheEvictBps:0 CachePromoteBps:0} MgrMap:{Epoch:0 ActiveGID:0 ActiveName: ActiveAddr: Available:false Standbys:[]} Fsmap:{Epoch:0 ID:0 Up:0 In:0 Max:0 ByRank:[] UpStandby:0}}
2026-05-19 20:04:31.985872 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: etcdserver: request timed out
2026-05-19 20:05:08.740809 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-05-19 20:05:10.993777 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:05:11.630502 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:05:13.028379 I | operator: rook-ceph-operator-config-controller done reconciling
2026-05-19 20:05:13.642708 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:05:28.817416 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: etcdserver: request timed out
2026-05-19 20:05:32.948149 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:05:41.589021 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:05:42.237152 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:06:12.146962 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:06:12.814380 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:06:14.989308 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:06:42.737018 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:06:43.427276 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:07:01.173617 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:07:13.393196 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:07:14.041452 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:07:43.970787 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:07:44.658654 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:07:47.361566 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:08:14.621301 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:08:15.243050 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:08:34.571407 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:08:45.218699 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:08:45.832033 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:09:15.810867 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:09:16.396132 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:09:20.752781 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:09:46.381276 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:09:46.966006 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:10:06.948935 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-05-19 20:10:16.972263 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:10:17.596345 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:10:47.540963 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:10:48.180254 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-05-19 20:10:53.164030 W | op-mon: external cluster mon count is 1, consider adding new monitors.