2026-03-31 20:37:36.302733 I | rookcmd: starting Rook v1.10.10 with arguments '/usr/local/bin/rook ceph operator'
2026-03-31 20:37:36.302842 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO, --operator-image=, --service-account=
2026-03-31 20:37:36.302847 I | cephcmd: starting Rook-Ceph operator
2026-03-31 20:37:36.616435 I | cephcmd: base ceph version inside the rook operator image is "ceph version 17.2.5 (98318ae89f1a893a6ded3a640405cdbb33e08757) quincy (stable)"
2026-03-31 20:37:36.625446 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var)
2026-03-31 20:37:36.625476 I | operator: watching all namespaces for Ceph CRs
2026-03-31 20:37:36.625530 I | operator: setting up schemes
2026-03-31 20:37:36.628319 I | operator: setting up the controller-runtime manager
2026-03-31 20:37:37.435171 I | op-k8sutil: ROOK_DISABLE_ADMISSION_CONTROLLER="true" (configmap)
2026-03-31 20:37:37.435199 I | operator: delete webhook resources since webhook is disabled
2026-03-31 20:37:37.435206 I | operator: deleting validating webhook rook-ceph-webhook
2026-03-31 20:37:37.437912 I | operator: deleting webhook cert manager Certificate rook-admission-controller-cert
2026-03-31 20:37:37.440385 I | operator: deleting webhook cert manager Issuer %sselfsigned-issuer
2026-03-31 20:37:37.442373 I | operator: deleting validating webhook service %srook-ceph-admission-controller
2026-03-31 20:37:37.444786 I | ceph-cluster-controller: successfully started
2026-03-31 20:37:37.444913 I | ceph-cluster-controller: enabling hotplug orchestration
2026-03-31 20:37:37.444945 I | ceph-crashcollector-controller: successfully started
2026-03-31 20:37:37.444978 I | ceph-block-pool-controller: successfully started
2026-03-31 20:37:37.445012 I | ceph-object-store-user-controller: successfully started
2026-03-31 20:37:37.445042 I | ceph-object-realm-controller: successfully started
2026-03-31 20:37:37.445063 I | ceph-object-zonegroup-controller: successfully started
2026-03-31 20:37:37.445084 I | ceph-object-zone-controller: successfully started
2026-03-31 20:37:37.445223 I | ceph-object-controller: successfully started
2026-03-31 20:37:37.445260 I | ceph-file-controller: successfully started
2026-03-31 20:37:37.445302 I | ceph-nfs-controller: successfully started
2026-03-31 20:37:37.445333 I | ceph-rbd-mirror-controller: successfully started
2026-03-31 20:37:37.445362 I | ceph-client-controller: successfully started
2026-03-31 20:37:37.445382 I | ceph-filesystem-mirror-controller: successfully started
2026-03-31 20:37:37.445421 I | operator: rook-ceph-operator-config-controller successfully started
2026-03-31 20:37:37.448641 I | op-k8sutil: ROOK_DISABLE_ADMISSION_CONTROLLER="true" (configmap)
2026-03-31 20:37:37.448693 I | ceph-csi: rook-ceph-operator-csi-controller successfully started
2026-03-31 20:37:37.448737 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started
2026-03-31 20:37:37.448769 I | ceph-bucket-topic: successfully started
2026-03-31 20:37:37.448786 I | ceph-bucket-notification: successfully started
2026-03-31 20:37:37.448818 I | ceph-bucket-notification: successfully started
2026-03-31 20:37:37.448847 I | ceph-fs-subvolumegroup-controller: successfully started
2026-03-31 20:37:37.448884 I | blockpool-rados-namespace-controller: successfully started
2026-03-31 20:37:37.449740 I | operator: starting the controller-runtime manager
2026-03-31 20:37:37.983162 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap)
2026-03-31 20:37:37.983193 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap)
2026-03-31 20:37:37.983225 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (env var)
2026-03-31 20:37:37.986358 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap)
2026-03-31 20:37:37.986379 I | operator: rook-ceph-operator-config-controller done reconciling
2026-03-31 20:37:38.082609 I | ceph-csi: CSI Ceph RBD driver disabled
2026-03-31 20:37:38.082643 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-03-31 20:37:38.086260 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-03-31 20:37:38.093559 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-03-31 20:37:38.093588 I | ceph-csi: CSI CephFS driver disabled
2026-03-31 20:37:38.093598 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-03-31 20:37:38.096391 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-03-31 20:37:38.101755 I | ceph-csi: successfully removed CSI CephFS driver
2026-03-31 20:37:38.101768 I | ceph-csi: CSI NFS driver disabled
2026-03-31 20:37:38.101773 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-03-31 20:37:38.104303 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-03-31 20:37:38.110788 I | ceph-csi: successfully removed CSI NFS driver
2026-03-31 20:37:57.175012 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph"
2026-03-31 20:37:57.177000 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap)
2026-03-31 20:37:57.179458 I | clusterdisruption-controller: deleted all legacy node drain canary pods
2026-03-31 20:37:57.182256 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph"
2026-03-31 20:37:57.187605 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-31 20:37:57.187629 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-31 20:37:57.188526 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap)
2026-03-31 20:37:57.188548 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket"
2026-03-31 20:37:57.188911 I | op-bucket-prov: successfully reconciled bucket provisioner
I0331 20:37:57.188981       1 manager.go:135] objectbucket.io/provisioner-manager "msg"="starting provisioner" "name"="openstack.ceph.rook.io/bucket"
2026-03-31 20:37:57.190554 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack"
2026-03-31 20:37:57.199215 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-03-31 20:37:57.215076 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-31 20:37:57.215102 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-31 20:37:57.215155 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001b8e2a0]
2026-03-31 20:37:57.215178 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1...
2026-03-31 20:37:57.223363 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap)
2026-03-31 20:37:57.223387 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap)
2026-03-31 20:37:57.223392 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap)
2026-03-31 20:37:57.223397 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default)
2026-03-31 20:37:57.223401 I | op-k8sutil: ROOK_CSI_ENABLE_GRPC_METRICS="false" (configmap)
2026-03-31 20:37:57.223406 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap)
2026-03-31 20:37:57.223409 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap)
2026-03-31 20:37:57.223414 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap)
2026-03-31 20:37:57.223418 I | op-k8sutil: CSI_CEPHFS_GRPC_METRICS_PORT="9091" (default)
2026-03-31 20:37:57.223421 I | op-k8sutil: CSI_CEPHFS_GRPC_METRICS_PORT="9091" (default)
2026-03-31 20:37:57.223426 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default)
2026-03-31 20:37:57.223430 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default)
2026-03-31 20:37:57.223435 I | op-k8sutil: CSI_RBD_GRPC_METRICS_PORT="9090" (default)
2026-03-31 20:37:57.223440 I | op-k8sutil: CSI_RBD_GRPC_METRICS_PORT="9090" (default)
2026-03-31 20:37:57.223468 I | op-k8sutil: CSIADDONS_PORT="9070" (default)
2026-03-31 20:37:57.223644 I | op-k8sutil: CSIADDONS_PORT="9070" (default)
2026-03-31 20:37:57.223651 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default)
2026-03-31 20:37:57.223654 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default)
2026-03-31 20:37:57.223658 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default)
2026-03-31 20:37:57.223662 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap)
2026-03-31 20:37:57.223666 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap)
2026-03-31 20:37:57.223670 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap)
2026-03-31 20:37:57.223674 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap)
2026-03-31 20:37:57.223677 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap)
2026-03-31 20:37:57.223681 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap)
2026-03-31 20:37:57.223685 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap)
2026-03-31 20:37:57.223690 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap)
2026-03-31 20:37:57.223693 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap)
2026-03-31 20:37:57.223697 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap)
2026-03-31 20:37:57.223701 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-03-31 20:37:57.224503 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-03-31 20:37:57.224519 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default)
2026-03-31 20:37:57.224524 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default)
2026-03-31 20:37:57.224528 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap)
2026-03-31 20:37:57.224532 I | ceph-csi: Kubernetes version is 1.28
2026-03-31 20:37:57.224536 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.7.0" (default)
2026-03-31 20:37:57.224540 I | op-k8sutil: CSI_LOG_LEVEL="" (default)
2026-03-31 20:37:57.224544 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default)
2026-03-31 20:37:57.387821 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.7.2" (default)
2026-03-31 20:37:57.387855 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.7.0" (default)
2026-03-31 20:37:57.387864 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v3.4.0" (default)
2026-03-31 20:37:57.387871 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.1.0" (default)
2026-03-31 20:37:57.387878 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v6.2.1" (default)
2026-03-31 20:37:57.387884 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default)
2026-03-31 20:37:57.387891 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.5.0" (configmap)
2026-03-31 20:37:57.387897 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default)
2026-03-31 20:37:57.387902 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default)
2026-03-31 20:37:57.387909 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default)
2026-03-31 20:37:57.387914 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default)
2026-03-31 20:37:57.387920 I | op-k8sutil: CSI_CLUSTER_NAME="" (default)
2026-03-31 20:37:57.387927 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap)
2026-03-31 20:37:57.387933 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled
2026-03-31 20:37:57.387940 I | ceph-csi: CSI Ceph RBD driver disabled
2026-03-31 20:37:57.387948 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-03-31 20:37:57.390125 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-03-31 20:37:57.781475 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-03-31 20:37:57.781514 I | ceph-csi: CSI CephFS driver disabled
2026-03-31 20:37:57.781532 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-03-31 20:37:57.784351 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-03-31 20:37:57.981059 I | ceph-csi: successfully removed CSI CephFS driver
2026-03-31 20:37:57.981089 I | ceph-csi: CSI NFS driver disabled
2026-03-31 20:37:57.981098 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-03-31 20:37:57.983423 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-03-31 20:37:58.181999 I | ceph-csi: successfully removed CSI NFS driver
2026-03-31 20:38:13.948888 I | ceph-spec: detected ceph image version: "18.2.1-0 reef"
2026-03-31 20:38:13.948911 I | ceph-cluster-controller: validating ceph version from provided image
2026-03-31 20:38:13.954100 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-31 20:38:13.954125 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-31 20:38:13.956191 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config
2026-03-31 20:38:13.956316 I | cephclient: generated admin config in /var/lib/rook/openstack
2026-03-31 20:38:15.201427 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 <unknown version>", consider upgrading
2026-03-31 20:38:16.623502 W | ceph-cluster-controller: image spec version 18.2.1-0 reef is lower than the running cluster version 18.2.7-0 reef, downgrading is not supported
2026-03-31 20:38:18.195850 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.1-0 reef"
2026-03-31 20:38:18.195878 I | ceph-cluster-controller: cluster "openstack": version "18.2.1-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1"
2026-03-31 20:38:18.216530 I | ceph-cluster-controller: creating "rook-config-override" configmap
2026-03-31 20:38:18.278914 I | ceph-cluster-controller: creating "rook-ceph-config" secret
2026-03-31 20:38:18.291358 I | ceph-cluster-controller: external cluster identity established
2026-03-31 20:38:18.291383 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner"
2026-03-31 20:38:20.497855 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings
2026-03-31 20:38:20.497886 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd
2026-03-31 20:38:20.578779 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:38:21.108044 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node"
2026-03-31 20:38:23.203615 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:38:24.095338 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner"
2026-03-31 20:38:26.106943 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:38:26.545021 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node"
2026-03-31 20:38:27.827336 I | ceph-csi: created kubernetes csi secrets for cluster "openstack"
2026-03-31 20:38:27.831718 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-03-31 20:38:28.004733 I | ceph-cluster-controller: successfully updated csi config map
2026-03-31 20:38:28.004760 I | cephclient: getting or creating ceph auth key "client.crash"
2026-03-31 20:38:29.217926 I | ceph-crashcollector-controller: created kubernetes crash collector secret for cluster "openstack"
2026-03-31 20:38:29.217974 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack"
2026-03-31 20:38:29.218002 I | ceph-cluster-controller: ceph status check interval is 1m0s
2026-03-31 20:38:29.218009 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack"
2026-03-31 20:38:37.308292 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-31 20:38:37.308332 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-31 20:38:37.308349 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1...
2026-03-31 20:38:39.426102 I | ceph-spec: detected ceph image version: "18.2.1-0 reef"
2026-03-31 20:38:42.589083 I | ceph-object-controller: reconciling object store deployments
2026-03-31 20:38:42.602884 I | ceph-object-controller: ceph object store gateway service running at 10.105.24.210
2026-03-31 20:38:42.602920 I | ceph-object-controller: reconciling object store pools
2026-03-31 20:38:48.094961 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-03-31 20:38:50.089360 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-03-31 20:38:52.903006 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:38:54.999900 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:38:59.159828 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-03-31 20:39:01.028981 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-03-31 20:39:07.288476 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-03-31 20:39:09.392533 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-03-31 20:39:19.285152 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:39:21.532541 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-03-31 20:39:24.286694 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-03-31 20:39:25.801083 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:39:27.700848 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:39:35.195844 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-03-31 20:39:38.510515 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-03-31 20:39:45.293446 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-03-31 20:39:47.294232 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-03-31 20:39:53.421962 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-03-31 20:39:55.408716 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-03-31 20:39:58.401332 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:74} {StateName:creating+peering Count:7}]"
2026-03-31 20:39:58.480115 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:40:00.692889 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:40:07.601029 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-03-31 20:40:09.294588 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:40:10.606875 I | ceph-object-controller: setting multisite settings for object store "ceph"
2026-03-31 20:40:12.036337 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph"
2026-03-31 20:40:12.470740 I | ceph-object-controller: Multisite for object-store: realm=ceph, zonegroup=ceph, zone=ceph
2026-03-31 20:40:12.470774 I | ceph-object-controller: multisite configuration for object-store ceph is complete
2026-03-31 20:40:12.470784 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-03-31 20:40:12.470798 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-03-31 20:40:13.707697 I | ceph-object-controller: setting rgw config flags
2026-03-31 20:40:13.707732 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-03-31 20:40:14.704889 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database
2026-03-31 20:40:14.704929 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-03-31 20:40:15.711338 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database
2026-03-31 20:40:15.711373 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-03-31 20:40:16.699125 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database
2026-03-31 20:40:16.699153 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-03-31 20:40:17.696871 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database
2026-03-31 20:40:17.696907 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-03-31 20:40:18.632168 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database
2026-03-31 20:40:18.632443 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-03-31 20:40:18.719006 I | ceph-object-controller: enabling rgw dashboard
2026-03-31 20:40:18.759218 E | ceph-crashcollector-controller: node reconcile failed on op "unchanged": Operation cannot be fulfilled on deployments.apps "rook-ceph-crashcollector-instance": the object has been modified; please apply your changes to the latest version and try again
2026-03-31 20:40:18.788433 E | ceph-crashcollector-controller: node reconcile failed on op "unchanged": Operation cannot be fulfilled on deployments.apps "rook-ceph-crashcollector-instance": the object has been modified; please apply your changes to the latest version and try again
2026-03-31 20:40:18.816487 E | ceph-crashcollector-controller: node reconcile failed on op "unchanged": Operation cannot be fulfilled on deployments.apps "rook-ceph-crashcollector-instance": the object has been modified; please apply your changes to the latest version and try again
2026-03-31 20:40:22.610533 I | ceph-object-controller: setting the dashboard api secret key
2026-03-31 20:40:22.611163 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-03-31 20:40:23.298891 I | ceph-object-controller: starting rgw health checker for CephObjectStore "openstack/ceph"
2026-03-31 20:40:24.500239 I | ceph-object-controller: done setting the dashboard api secret key
2026-03-31 20:40:25.316110 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:40:29.634804 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:40:31.906980 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:40:59.192618 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:41:01.598099 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:41:02.099022 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:41:03.306816 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:41:33.317378 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:110} {StateName:peering Count:2} {StateName:clean+premerge+peered Count:1}]"
2026-03-31 20:41:33.323794 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:41:34.578798 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:111} {StateName:peering Count:1}]"
2026-03-31 20:41:34.587361 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:41:49.032025 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:41:59.314530 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:132} {StateName:active+recovering Count:1}]"
2026-03-31 20:41:59.319935 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:42:04.397565 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:129} {StateName:peering Count:3}]"
2026-03-31 20:42:04.404147 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:42:05.725056 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:129} {StateName:peering Count:3}]"
2026-03-31 20:42:05.778892 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:42:37.502314 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:125} {StateName:peering Count:2}]"
2026-03-31 20:42:37.580197 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:42:39.207528 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:42:39.728032 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:43:00.632104 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:43:08.801625 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:121} {StateName:activating Count:1}]"
2026-03-31 20:43:08.810843 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:43:10.893964 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:121} {StateName:activating Count:1}]"
2026-03-31 20:43:10.899047 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:43:26.713396 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:43:40.009831 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:43:42.083496 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:44:01.998476 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:44:11.185569 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:44:14.710257 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:44:15.708169 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:44:42.403726 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:44:45.900199 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:04.588344 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:45:04.727721 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:13.604618 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:17.106370 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:44.829394 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:48.325336 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:45:55.392519 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:46:04.498750 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:46:16.007965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:46:19.480256 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:46:42.811742 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:46:47.201452 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:46:50.717831 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:47:05.795269 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:47:18.400393 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:47:21.802191 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:47:30.182536 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:47:49.621797 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:47:53.020167 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:48:07.009987 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:48:17.635124 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:48:20.803040 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:48:24.186820 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:48:52.004343 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:48:55.408259 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-31 20:49:05.187656 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-31 20:49:08.311367 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0