2026/09/10 02:13:14 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-09-10 02:13:14.401031 I | rookcmd: starting Rook v1.14.5 with arguments '/usr/local/bin/rook ceph operator' 2026-09-10 02:13:14.401056 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-09-10 02:13:14.401060 I | cephcmd: starting Rook-Ceph operator 2026-09-10 02:13:14.568403 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-09-10 02:13:14.577252 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-09-10 02:13:14.577279 I | operator: watching all namespaces for Ceph CRs 2026-09-10 02:13:14.577526 I | operator: setting up schemes 2026-09-10 02:13:14.581222 I | operator: setting up the controller-runtime manager 2026-09-10 02:13:14.581909 I | ceph-cluster-controller: successfully started 2026-09-10 02:13:14.585602 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-09-10 02:13:14.585621 I | ceph-cluster-controller: enabling hotplug orchestration 2026-09-10 02:13:14.585643 I | ceph-nodedaemon-controller: successfully started 2026-09-10 02:13:14.585662 I | ceph-block-pool-controller: successfully started 2026-09-10 02:13:14.585681 I | ceph-object-store-user-controller: successfully started 2026-09-10 02:13:14.585704 I | ceph-object-realm-controller: successfully started 2026-09-10 02:13:14.585720 I | ceph-object-zonegroup-controller: successfully started 2026-09-10 02:13:14.585745 I | ceph-object-zone-controller: successfully started 2026-09-10 02:13:14.585875 I | ceph-object-controller: successfully started 2026-09-10 02:13:14.585913 I | ceph-file-controller: successfully started 2026-09-10 02:13:14.585940 I | ceph-nfs-controller: successfully started 2026-09-10 02:13:14.585984 I | ceph-rbd-mirror-controller: successfully started 2026-09-10 02:13:14.586010 I | ceph-client-controller: successfully started 2026-09-10 02:13:14.586028 I | ceph-filesystem-mirror-controller: successfully started 2026-09-10 02:13:14.586047 I | operator: rook-ceph-operator-config-controller successfully started 2026-09-10 02:13:14.586073 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-09-10 02:13:14.586183 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-09-10 02:13:14.586200 I | ceph-bucket-topic: successfully started 2026-09-10 02:13:14.586210 I | ceph-bucket-notification: successfully started 2026-09-10 02:13:14.586224 I | ceph-bucket-notification: successfully started 2026-09-10 02:13:14.586238 I | ceph-fs-subvolumegroup-controller: successfully started 2026-09-10 02:13:14.586250 I | blockpool-rados-namespace-controller: successfully started 2026-09-10 02:13:14.586338 I | ceph-cosi-controller: successfully started 2026-09-10 02:13:14.586370 I | operator: starting the controller-runtime manager 2026-09-10 02:13:14.740191 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-09-10 02:13:14.794117 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-09-10 02:13:14.794155 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-09-10 02:13:14.794177 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-09-10 02:13:14.797996 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-09-10 02:13:14.798014 I | operator: rook-ceph-operator-config-controller done reconciling 2026-09-10 02:13:14.806685 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-09-10 02:13:14.806751 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-09-10 02:13:14.807655 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-10 02:13:14.807674 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-10 02:13:14.810239 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-10 02:13:14.816806 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-10 02:13:14.816822 I | ceph-csi: CSI CephFS driver disabled 2026-09-10 02:13:14.816830 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-10 02:13:14.819075 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-10 02:13:14.826293 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-10 02:13:14.826339 I | ceph-csi: CSI NFS driver disabled 2026-09-10 02:13:14.826347 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-10 02:13:14.828824 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-10 02:13:14.838197 I | ceph-csi: successfully removed CSI NFS driver 2026-09-10 02:13:36.045426 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-09-10 02:13:36.050052 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-09-10 02:13:36.054886 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-09-10 02:13:36.065082 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:13:36.065120 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:13:36.065317 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-09-10 02:13:36.065637 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-09-10 02:13:36.065656 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-09-10 02:13:36.066319 I | op-bucket-prov: successfully reconciled bucket provisioner I0910 02:13:36.066544 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-09-10 02:13:36.071935 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-09-10 02:13:36.103991 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-09-10 02:13:36.104030 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-09-10 02:13:36.104728 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:13:36.104756 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:13:36.104781 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001729080] 2026-09-10 02:13:36.104804 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-10 02:13:36.650311 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:13:36.650344 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:13:37.048597 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-09-10 02:13:37.048620 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-09-10 02:13:37.048624 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-09-10 02:13:37.048630 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-09-10 02:13:37.048635 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-09-10 02:13:37.048639 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-09-10 02:13:37.048645 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-09-10 02:13:37.048651 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-09-10 02:13:37.048656 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-09-10 02:13:37.048661 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-09-10 02:13:37.048665 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-09-10 02:13:37.048670 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-09-10 02:13:37.048676 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-09-10 02:13:37.048682 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-09-10 02:13:37.048722 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-09-10 02:13:37.048728 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-09-10 02:13:37.050924 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-09-10 02:13:37.050939 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-09-10 02:13:37.050944 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-09-10 02:13:37.050948 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-09-10 02:13:37.050952 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-10 02:13:37.050956 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-10 02:13:37.050960 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-10 02:13:37.050964 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-10 02:13:37.050968 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-10 02:13:37.050973 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-09-10 02:13:37.050976 I | ceph-csi: Kubernetes version is 1.28 2026-09-10 02:13:37.051148 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-09-10 02:13:37.051163 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-09-10 02:13:37.051167 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-09-10 02:13:37.051172 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-09-10 02:13:37.051176 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-09-10 02:13:37.250674 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-09-10 02:13:37.250707 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.1" (configmap) 2026-09-10 02:13:37.250716 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.1" (configmap) 2026-09-10 02:13:37.250724 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.1" (configmap) 2026-09-10 02:13:37.250732 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.2" (configmap) 2026-09-10 02:13:37.250748 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.1" (configmap) 2026-09-10 02:13:37.250936 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-09-10 02:13:37.250961 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-09-10 02:13:37.250969 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-09-10 02:13:37.250979 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-09-10 02:13:37.251015 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-09-10 02:13:37.251103 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-09-10 02:13:37.251118 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-09-10 02:13:37.251125 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-09-10 02:13:37.251131 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-09-10 02:13:37.251138 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-09-10 02:13:37.251286 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-09-10 02:13:37.251305 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-09-10 02:13:37.251313 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-09-10 02:13:37.254565 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-09-10 02:13:37.254584 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-09-10 02:13:37.254590 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-10 02:13:37.254596 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-10 02:13:37.258331 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-10 02:13:37.450345 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-10 02:13:37.450372 I | ceph-csi: CSI CephFS driver disabled 2026-09-10 02:13:37.450380 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-10 02:13:37.452207 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-10 02:13:37.651713 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-10 02:13:37.651750 I | ceph-csi: CSI NFS driver disabled 2026-09-10 02:13:37.651761 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-10 02:13:37.655330 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-10 02:13:37.852204 I | ceph-csi: successfully removed CSI NFS driver 2026-09-10 02:13:54.587275 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-10 02:13:54.587300 I | ceph-cluster-controller: validating ceph version from provided image 2026-09-10 02:13:54.594711 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:13:54.594743 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:13:54.597160 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-09-10 02:13:54.597261 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-09-10 02:13:55.096063 E | cephver: external cluster ceph version is a major version higher "18.2.8-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-09-10 02:13:55.620527 W | ceph-cluster-controller: image spec version 18.2.7-0 reef is lower than the running cluster version 18.2.8-0 reef, downgrading is not supported 2026-09-10 02:13:56.139888 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.7-0 reef" 2026-09-10 02:13:56.139928 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7" 2026-09-10 02:13:56.158505 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-09-10 02:13:56.161694 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-09-10 02:13:56.173945 I | ceph-cluster-controller: external cluster identity established 2026-09-10 02:13:56.173982 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-09-10 02:13:57.564076 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-09-10 02:13:57.564116 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-09-10 02:13:57.573614 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:13:57.579966 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-09-10 02:13:58.997697 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:13:59.257872 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-09-10 02:14:00.495830 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:14:00.663350 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-09-10 02:14:01.283215 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-09-10 02:14:01.289497 I | ceph-cluster-controller: successfully updated csi config map 2026-09-10 02:14:01.289531 I | cephclient: getting or creating ceph auth key "client.crash" 2026-09-10 02:14:01.864230 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-09-10 02:14:01.867389 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-09-10 02:14:01.867420 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-09-10 02:14:01.867427 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-09-10 02:14:06.143710 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:14:06.143741 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:14:06.143757 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-10 02:14:08.205273 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-10 02:14:09.603617 I | ceph-object-controller: reconciling object store deployments 2026-09-10 02:14:09.621612 I | ceph-object-controller: ceph object store gateway service running at 10.107.236.169 2026-09-10 02:14:09.621646 I | ceph-object-controller: reconciling object store pools 2026-09-10 02:14:12.917474 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-10 02:14:13.787996 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-09-10 02:14:13.788030 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-09-10 02:14:13.788038 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-09-10 02:14:15.961873 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-09-10 02:14:15.961908 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-10 02:14:20.097717 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-10 02:14:21.039853 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-09-10 02:14:21.039893 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-09-10 02:14:21.039903 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-09-10 02:14:23.153024 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-09-10 02:14:23.153064 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-10 02:14:29.281982 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:17} {StateName:unknown Count:4} {StateName:creating+peering Count:4}]" 2026-09-10 02:14:29.287363 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:14:30.186361 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:17} {StateName:unknown Count:4} {StateName:creating+peering Count:4}]" 2026-09-10 02:14:30.191020 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:14:30.309381 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-10 02:14:31.425217 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-09-10 02:14:31.425324 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-09-10 02:14:31.425363 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-09-10 02:14:33.358057 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-09-10 02:14:33.358180 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-10 02:14:37.441057 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-10 02:14:38.248524 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-09-10 02:14:38.248555 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-09-10 02:14:38.248562 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-09-10 02:14:40.510751 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-09-10 02:14:40.510785 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-10 02:14:44.589328 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-10 02:14:45.495588 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-09-10 02:14:45.495612 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-09-10 02:14:45.495617 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-09-10 02:14:47.670283 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-09-10 02:14:47.670323 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-10 02:14:48.964632 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:14:52.740514 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-10 02:14:53.680889 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-09-10 02:14:53.680934 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-09-10 02:14:53.680944 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-09-10 02:14:55.841679 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-09-10 02:14:55.841732 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-10 02:15:00.689756 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:00.935817 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-10 02:15:01.749169 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:49} {StateName:unknown Count:6} {StateName:creating+peering Count:2}]" 2026-09-10 02:15:01.753345 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:02.357429 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-09-10 02:15:02.357483 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-09-10 02:15:02.357490 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-09-10 02:15:04.993211 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-09-10 02:15:04.993249 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-10 02:15:09.067374 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-10 02:15:10.005401 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-09-10 02:15:10.005421 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-09-10 02:15:10.005425 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-09-10 02:15:12.162966 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-09-10 02:15:12.163002 I | ceph-object-controller: configuring object store "ceph" 2026-09-10 02:15:12.909185 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-10 02:15:13.156663 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-10 02:15:13.612021 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-10 02:15:13.612056 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-10 02:15:13.617393 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-10 02:15:14.207413 I | ceph-object-controller: setting rgw config flags 2026-09-10 02:15:14.207480 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-10 02:15:14.654254 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-10 02:15:14.654301 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-10 02:15:15.047167 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-10 02:15:15.047206 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-10 02:15:15.481408 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-10 02:15:15.481473 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-10 02:15:16.004163 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-10 02:15:16.004207 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-10 02:15:16.523323 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-10 02:15:16.523356 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-10 02:15:16.973205 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-10 02:15:16.973397 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-10 02:15:17.023802 I | ceph-object-controller: enabling rgw dashboard 2026-09-10 02:15:19.016369 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-10 02:15:19.017145 I | ceph-object-controller: setting the dashboard api secret key 2026-09-10 02:15:19.632393 I | ceph-object-controller: done setting the dashboard api secret key 2026-09-10 02:15:31.243782 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:58} {StateName:unknown Count:31}]" 2026-09-10 02:15:31.248857 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:32.242419 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:58} {StateName:unknown Count:31}]" 2026-09-10 02:15:32.246769 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:34.968291 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:15:49.419793 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.107.236.169:80: i/o timeout 2026-09-10 02:15:49.451693 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-10 02:15:49.451724 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-10 02:15:49.451741 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-10 02:15:49.957492 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:50.465227 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:15:52.159893 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-10 02:15:53.530082 I | ceph-object-controller: reconciling object store deployments 2026-09-10 02:15:53.565043 I | ceph-object-controller: ceph object store gateway service running at 10.107.236.169 2026-09-10 02:15:53.565074 I | ceph-object-controller: reconciling object store pools 2026-09-10 02:15:54.988708 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-09-10 02:15:54.988749 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-10 02:15:55.809291 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-10 02:15:57.562535 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-09-10 02:15:57.562554 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-10 02:15:58.325168 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-10 02:16:00.577643 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-09-10 02:16:00.577671 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-10 02:16:01.799982 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-10 02:16:02.298516 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:16:03.251921 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:16:04.785344 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-09-10 02:16:04.785507 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-10 02:16:07.251126 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-10 02:16:09.925591 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-09-10 02:16:09.925694 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-10 02:16:10.871385 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-10 02:16:12.883618 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-09-10 02:16:12.883666 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-10 02:16:13.751941 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-10 02:16:15.922521 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-09-10 02:16:15.922562 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-10 02:16:16.760474 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-10 02:16:18.958665 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-09-10 02:16:18.958695 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-10 02:16:19.817760 I | ceph-object-controller: configuring object store "ceph" 2026-09-10 02:16:20.184604 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-10 02:16:20.685375 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-10 02:16:20.685425 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-10 02:16:20.685433 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-10 02:16:20.690642 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-10 02:16:22.193052 I | ceph-object-controller: setting rgw config flags 2026-09-10 02:16:22.193089 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-10 02:16:22.786939 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:16:23.048361 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-10 02:16:23.048395 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-10 02:16:23.428676 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-10 02:16:23.428711 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-10 02:16:23.892728 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-10 02:16:23.892765 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-10 02:16:24.350887 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-10 02:16:24.350925 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-10 02:16:24.785745 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-10 02:16:24.785777 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-10 02:16:25.227440 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-10 02:16:25.227753 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-10 02:16:25.250977 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-09-10 02:16:25.262322 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-09-10 02:16:25.267294 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-09-10 02:16:25.273303 I | ceph-object-controller: enabling rgw dashboard 2026-09-10 02:16:26.423878 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-10 02:16:27.658856 I | ceph-object-controller: creating COSI user "cosi" 2026-09-10 02:16:27.768643 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-09-10 02:16:28.349479 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:16:32.832721 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:16:33.802981 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:17:03.325075 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:17:04.347770 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:17:10.886299 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:17:33.845917 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:106} {StateName:unknown Count:15}]" 2026-09-10 02:17:33.850674 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:17:34.862363 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:112} {StateName:unknown Count:9}]" 2026-09-10 02:17:34.865779 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:17:56.916271 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:18:04.371111 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:18:05.432819 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:18:34.916016 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:18:36.034668 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:18:43.035975 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:19:05.456610 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:19:06.561522 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:19:29.139324 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:19:35.970748 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:19:37.053079 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:20:06.571200 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:20:07.584021 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:20:15.311721 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:20:37.137441 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:20:38.095107 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:21:01.384921 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:21:07.680782 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:21:08.587010 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:21:38.198563 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:21:39.141883 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:166} {StateName:peering Count:19}]" 2026-09-10 02:21:39.147300 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:21:47.467955 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:22:08.721362 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:22:09.689819 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:22:33.488772 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:22:39.270614 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:22:40.208811 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:23:09.825257 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:23:10.729579 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:23:19.519967 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:23:40.324671 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:23:41.243961 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:24:05.623057 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:24:10.862471 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:24:11.765332 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:24:41.421425 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:24:42.322702 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:24:51.691134 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:25:11.987320 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:25:12.904625 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:25:37.728119 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:25:42.548032 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:25:43.437996 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:26:13.255508 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:26:14.291630 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:26:23.769757 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:26:43.788024 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:26:44.828609 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:27:09.846252 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:27:14.293413 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:27:15.325646 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:27:44.876164 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:27:45.863772 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:27:55.910523 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:28:15.375441 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:28:16.377634 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:28:41.947558 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:28:45.961189 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:28:46.890524 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:29:16.490202 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:29:17.418020 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:29:28.111165 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:29:47.049178 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:29:47.923656 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:30:14.126869 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:30:17.574409 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:30:18.445277 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:30:48.101981 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:30:48.993991 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:31:00.206667 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:31:18.604594 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:31:19.525587 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:31:46.224006 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:31:49.144298 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:31:50.006768 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:32:19.670864 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:32:20.532569 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:32:32.230339 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:32:50.231622 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:32:51.082271 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:33:18.607394 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:33:20.800978 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:33:21.672591 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:33:51.361608 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:33:52.225408 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:34:04.665841 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:34:21.877290 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:34:22.742078 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:34:50.775393 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:34:52.371297 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:34:53.299623 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:35:22.896320 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:35:23.777849 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:35:36.832029 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:35:53.490182 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:35:54.302839 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:36:22.806131 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:36:24.007557 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:36:24.866364 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:36:54.538739 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:36:55.393984 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:37:08.876089 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:37:25.056700 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:37:26.008653 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:37:54.981706 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:37:55.609852 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:37:56.601655 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:38:26.145674 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:38:27.110285 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:38:41.042031 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:38:56.781273 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:38:58.967940 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:39:27.654122 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:39:27.860213 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:39:29.526733 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:39:58.391285 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:40:00.042769 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:40:13.836237 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:40:28.968775 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:40:30.607451 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:41:00.355778 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:41:00.755132 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:41:01.325499 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:41:30.882659 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:41:31.868281 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:41:46.825020 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:42:01.394796 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:42:02.443802 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:42:32.065447 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:42:33.866950 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:42:33.929999 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:43:02.622555 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:43:04.404798 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:43:20.008225 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:43:33.143319 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:43:34.944071 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:44:03.714617 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:44:05.965830 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:44:06.719492 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:44:34.230546 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:44:36.486631 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:44:52.849876 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:45:04.775338 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:45:06.968022 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:45:35.327004 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:45:37.546064 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:45:38.917071 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:46:05.825061 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:46:08.064700 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:46:25.000510 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:46:36.360845 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:46:38.601145 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:47:06.872026 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:47:09.148551 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:47:11.097312 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:47:37.438476 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:47:39.688661 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:47:57.212352 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:48:08.051207 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:48:10.235350 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:48:38.670629 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:48:40.804238 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:48:43.338471 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:49:09.184305 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:49:11.327861 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:49:29.485166 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:49:39.786073 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:49:41.899107 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:50:10.306873 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:50:12.415081 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:50:15.586984 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:50:40.847976 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:50:42.978223 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:51:01.676749 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:51:11.416656 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:51:13.501135 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:51:41.996152 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:51:44.044175 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:51:48.367395 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:52:12.486460 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:52:14.597132 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:52:34.474786 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:52:43.010760 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:52:45.156600 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:53:13.560472 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:53:15.656574 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:53:20.603479 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:53:44.142192 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:53:46.162284 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:54:06.668598 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:54:14.688127 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:54:16.682008 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:54:45.229545 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:54:47.272798 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:54:53.400648 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-10 02:55:15.808274 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-10 02:55:17.860338 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0