2026/09/09 06:32:37 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-09-09 06:32:37.578589 I | rookcmd: starting Rook v1.14.5 with arguments '/usr/local/bin/rook ceph operator' 2026-09-09 06:32:37.578617 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-09-09 06:32:37.578621 I | cephcmd: starting Rook-Ceph operator 2026-09-09 06:32:37.705100 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-09-09 06:32:37.712832 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-09-09 06:32:37.712858 I | operator: watching all namespaces for Ceph CRs 2026-09-09 06:32:37.712996 I | operator: setting up schemes 2026-09-09 06:32:37.715365 I | operator: setting up the controller-runtime manager 2026-09-09 06:32:37.715767 I | ceph-cluster-controller: successfully started 2026-09-09 06:32:37.719025 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-09-09 06:32:37.719045 I | ceph-cluster-controller: enabling hotplug orchestration 2026-09-09 06:32:37.719061 I | ceph-nodedaemon-controller: successfully started 2026-09-09 06:32:37.719078 I | ceph-block-pool-controller: successfully started 2026-09-09 06:32:37.719170 I | ceph-object-store-user-controller: successfully started 2026-09-09 06:32:37.719191 I | ceph-object-realm-controller: successfully started 2026-09-09 06:32:37.719215 I | ceph-object-zonegroup-controller: successfully started 2026-09-09 06:32:37.719297 I | ceph-object-zone-controller: successfully started 2026-09-09 06:32:37.719391 I | ceph-object-controller: successfully started 2026-09-09 06:32:37.719455 I | ceph-file-controller: successfully started 2026-09-09 06:32:37.719521 I | ceph-nfs-controller: successfully started 2026-09-09 06:32:37.719623 I | ceph-rbd-mirror-controller: successfully started 2026-09-09 06:32:37.719653 I | ceph-client-controller: successfully started 2026-09-09 06:32:37.719665 I | ceph-filesystem-mirror-controller: successfully started 2026-09-09 06:32:37.719683 I | operator: rook-ceph-operator-config-controller successfully started 2026-09-09 06:32:37.719694 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-09-09 06:32:37.719772 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-09-09 06:32:37.719786 I | ceph-bucket-topic: successfully started 2026-09-09 06:32:37.719794 I | ceph-bucket-notification: successfully started 2026-09-09 06:32:37.719805 I | ceph-bucket-notification: successfully started 2026-09-09 06:32:37.719817 I | ceph-fs-subvolumegroup-controller: successfully started 2026-09-09 06:32:37.719826 I | blockpool-rados-namespace-controller: successfully started 2026-09-09 06:32:37.719837 I | ceph-cosi-controller: successfully started 2026-09-09 06:32:37.719853 I | operator: starting the controller-runtime manager 2026-09-09 06:32:37.865813 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-09-09 06:32:38.127421 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-09-09 06:32:38.127455 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-09-09 06:32:38.127474 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-09-09 06:32:38.133793 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-09-09 06:32:38.133815 I | operator: rook-ceph-operator-config-controller done reconciling 2026-09-09 06:32:38.182842 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-09-09 06:32:38.182905 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-09-09 06:32:38.184281 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-09 06:32:38.184332 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-09 06:32:38.187429 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-09 06:32:38.200774 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-09 06:32:38.200801 I | ceph-csi: CSI CephFS driver disabled 2026-09-09 06:32:38.200809 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-09 06:32:38.203210 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-09 06:32:38.212621 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-09 06:32:38.212651 I | ceph-csi: CSI NFS driver disabled 2026-09-09 06:32:38.212661 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-09 06:32:38.215890 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-09 06:32:38.222355 I | ceph-csi: successfully removed CSI NFS driver 2026-09-09 06:32:59.325013 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-09-09 06:32:59.331643 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-09-09 06:32:59.333014 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-09-09 06:32:59.343465 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:32:59.343495 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:32:59.343628 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-09-09 06:32:59.343674 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-09-09 06:32:59.343681 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-09-09 06:32:59.344146 I | op-bucket-prov: successfully reconciled bucket provisioner I0909 06:32:59.344278 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-09-09 06:32:59.348793 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-09-09 06:32:59.362165 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-09-09 06:32:59.348898663 +0000 UTC m=+21.820142819 LastTransitionTime:2026-09-09 06:32:59.348898323 +0000 UTC m=+21.820142479}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again 2026-09-09 06:32:59.368567 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:32:59.368603 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:32:59.368630 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001645830] 2026-09-09 06:32:59.368651 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 06:32:59.530612 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-09-09 06:32:59.530642 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-09-09 06:33:00.132287 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:33:00.132357 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:33:00.331628 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-09-09 06:33:00.331660 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-09-09 06:33:00.331668 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-09-09 06:33:00.331676 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-09-09 06:33:00.331684 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-09-09 06:33:00.331692 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-09-09 06:33:00.331700 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-09-09 06:33:00.331710 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-09-09 06:33:00.331718 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-09-09 06:33:00.331726 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-09-09 06:33:00.331733 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-09-09 06:33:00.331741 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-09-09 06:33:00.331751 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-09-09 06:33:00.331765 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-09-09 06:33:00.331771 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-09-09 06:33:00.331777 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-09-09 06:33:00.334395 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-09-09 06:33:00.334419 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-09-09 06:33:00.334426 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-09-09 06:33:00.334432 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-09-09 06:33:00.334441 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 06:33:00.334447 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-09 06:33:00.334454 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 06:33:00.334463 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 06:33:00.334470 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-09 06:33:00.334477 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-09-09 06:33:00.334483 I | ceph-csi: Kubernetes version is 1.28 2026-09-09 06:33:00.334499 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-09-09 06:33:00.334505 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-09-09 06:33:00.334511 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-09-09 06:33:00.334572 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-09-09 06:33:00.334579 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-09-09 06:33:00.533632 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-09-09 06:33:00.533668 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.1" (configmap) 2026-09-09 06:33:00.533681 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.1" (configmap) 2026-09-09 06:33:00.533689 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.1" (configmap) 2026-09-09 06:33:00.533696 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.2" (configmap) 2026-09-09 06:33:00.533711 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.1" (configmap) 2026-09-09 06:33:00.533722 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-09-09 06:33:00.533730 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-09-09 06:33:00.533740 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-09-09 06:33:00.533747 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-09-09 06:33:00.533753 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-09-09 06:33:00.533759 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-09-09 06:33:00.533765 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-09-09 06:33:00.533772 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-09-09 06:33:00.533778 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-09-09 06:33:00.533784 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-09-09 06:33:00.533791 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-09-09 06:33:00.533797 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-09-09 06:33:00.533804 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-09-09 06:33:00.536372 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-09-09 06:33:00.536392 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-09-09 06:33:00.536399 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-09 06:33:00.536405 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-09 06:33:00.539055 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-09 06:33:00.733789 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-09 06:33:00.733816 I | ceph-csi: CSI CephFS driver disabled 2026-09-09 06:33:00.733824 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-09 06:33:00.736466 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-09 06:33:00.933634 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-09 06:33:00.933660 I | ceph-csi: CSI NFS driver disabled 2026-09-09 06:33:00.933667 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-09 06:33:00.936268 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-09 06:33:01.133716 I | ceph-csi: successfully removed CSI NFS driver 2026-09-09 06:33:17.620100 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 06:33:17.620129 I | ceph-cluster-controller: validating ceph version from provided image 2026-09-09 06:33:17.627626 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:33:17.627651 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:33:17.632548 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-09-09 06:33:17.632792 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-09-09 06:33:18.228402 E | cephver: external cluster ceph version is a major version higher "18.2.8-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-09-09 06:33:18.893640 W | ceph-cluster-controller: image spec version 18.2.7-0 reef is lower than the running cluster version 18.2.8-0 reef, downgrading is not supported 2026-09-09 06:33:19.508212 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.7-0 reef" 2026-09-09 06:33:19.508255 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7" 2026-09-09 06:33:19.531347 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-09-09 06:33:19.534006 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-09-09 06:33:19.545443 I | ceph-cluster-controller: external cluster identity established 2026-09-09 06:33:19.545491 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-09-09 06:33:20.770159 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-09-09 06:33:21.030213 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-09-09 06:33:21.030250 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-09-09 06:33:21.041427 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:33:22.330065 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-09-09 06:33:22.561255 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:33:23.843580 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-09-09 06:33:24.153060 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:33:24.750705 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-09-09 06:33:24.771286 I | ceph-cluster-controller: successfully updated csi config map 2026-09-09 06:33:24.771363 I | cephclient: getting or creating ceph auth key "client.crash" 2026-09-09 06:33:25.319856 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-09-09 06:33:25.322563 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-09-09 06:33:25.322596 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-09-09 06:33:25.322606 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-09-09 06:33:29.418734 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:33:29.418791 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:33:29.418829 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 06:33:31.966473 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 06:33:33.339294 I | ceph-object-controller: reconciling object store deployments 2026-09-09 06:33:33.352655 I | ceph-object-controller: ceph object store gateway service running at 10.105.204.29 2026-09-09 06:33:33.352676 I | ceph-object-controller: reconciling object store pools 2026-09-09 06:33:36.653763 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-09 06:33:37.460410 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-09-09 06:33:37.460438 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-09-09 06:33:37.460443 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-09-09 06:33:39.978958 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-09-09 06:33:39.979030 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-09 06:33:44.035637 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-09 06:33:44.923172 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-09-09 06:33:44.923211 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-09-09 06:33:44.923220 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-09-09 06:33:47.126095 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-09-09 06:33:47.126138 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-09 06:33:52.148216 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:33:52.220855 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-09 06:33:53.863294 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:17} {StateName:unknown Count:5} {StateName:creating+peering Count:3}]" 2026-09-09 06:33:53.867236 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:33:54.024889 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-09-09 06:33:54.024912 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-09-09 06:33:54.024917 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-09-09 06:33:56.249495 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-09-09 06:33:56.249528 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-09 06:34:00.996374 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-09 06:34:01.881387 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-09-09 06:34:01.881418 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-09-09 06:34:01.881426 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-09-09 06:34:04.338919 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-09-09 06:34:04.338953 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-09 06:34:08.433372 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-09 06:34:09.320205 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-09-09 06:34:09.320236 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-09-09 06:34:09.320241 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-09-09 06:34:12.095923 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:34:12.526884 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-09-09 06:34:12.526917 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-09 06:34:16.612970 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-09 06:34:17.483685 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-09-09 06:34:17.483720 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-09-09 06:34:17.483727 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-09-09 06:34:19.640429 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-09-09 06:34:19.640487 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-09 06:34:23.298745 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:34:25.450108 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:73} {StateName:unknown Count:8}]" 2026-09-09 06:34:25.454582 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:34:25.761417 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-09 06:34:26.946180 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-09-09 06:34:26.946219 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-09-09 06:34:26.946229 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-09-09 06:34:29.819835 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-09-09 06:34:29.819867 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-09 06:34:33.931089 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-09 06:34:34.764698 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-09-09 06:34:34.764739 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-09-09 06:34:34.764750 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-09-09 06:34:36.983480 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-09-09 06:34:36.983514 I | ceph-object-controller: configuring object store "ceph" 2026-09-09 06:34:37.751866 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-09 06:34:37.996412 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-09 06:34:38.487798 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-09 06:34:38.487855 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-09 06:34:38.494104 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-09 06:34:39.556470 I | ceph-object-controller: setting rgw config flags 2026-09-09 06:34:39.556511 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 06:34:40.018185 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 06:34:40.018229 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 06:34:40.464852 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 06:34:40.464890 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 06:34:40.984522 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 06:34:40.984556 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 06:34:41.443195 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 06:34:41.443218 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 06:34:41.884877 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 06:34:41.884913 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 06:34:42.309724 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 06:34:42.310058 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-09 06:34:42.378169 I | ceph-object-controller: enabling rgw dashboard 2026-09-09 06:34:44.352727 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-09 06:34:44.353383 I | ceph-object-controller: setting the dashboard api secret key 2026-09-09 06:34:44.866637 I | ceph-object-controller: done setting the dashboard api secret key 2026-09-09 06:34:53.802891 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:34:55.964753 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:34:58.100405 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:35:14.785577 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.105.204.29:80: i/o timeout 2026-09-09 06:35:14.807532 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 06:35:14.807561 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 06:35:14.807581 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 06:35:15.310243 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:99} {StateName:peering Count:12}]" 2026-09-09 06:35:15.314739 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:15.804910 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:99} {StateName:peering Count:12}]" 2026-09-09 06:35:15.808458 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:16.960977 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 06:35:18.302599 I | ceph-object-controller: reconciling object store deployments 2026-09-09 06:35:18.341444 I | ceph-object-controller: ceph object store gateway service running at 10.105.204.29 2026-09-09 06:35:18.341475 I | ceph-object-controller: reconciling object store pools 2026-09-09 06:35:19.589876 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-09-09 06:35:19.589913 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-09 06:35:20.436518 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-09 06:35:23.203501 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-09-09 06:35:23.203531 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-09 06:35:24.169889 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-09 06:35:24.929058 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:27.467870 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:28.186202 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-09-09 06:35:28.186233 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-09 06:35:29.541506 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-09 06:35:32.411763 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-09-09 06:35:32.411816 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-09 06:35:33.377683 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-09 06:35:35.318902 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-09-09 06:35:35.318934 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-09 06:35:36.176652 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-09 06:35:38.408627 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-09-09 06:35:38.408649 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-09 06:35:39.260815 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-09 06:35:41.490713 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-09-09 06:35:41.490756 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-09 06:35:42.328371 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-09 06:35:45.741953 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:35:46.117084 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-09-09 06:35:46.117129 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-09 06:35:46.930578 I | ceph-object-controller: configuring object store "ceph" 2026-09-09 06:35:47.260296 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-09 06:35:47.518259 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-09 06:35:47.518297 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-09 06:35:47.518307 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-09 06:35:47.525812 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-09 06:35:48.069995 I | ceph-object-controller: setting rgw config flags 2026-09-09 06:35:48.070028 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 06:35:48.484322 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 06:35:48.484619 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 06:35:48.942545 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 06:35:48.942581 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 06:35:49.354947 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 06:35:49.354985 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 06:35:49.764964 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 06:35:49.764992 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 06:35:50.241117 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 06:35:50.241150 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 06:35:50.677038 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 06:35:50.677367 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-09 06:35:50.696182 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-09-09 06:35:50.708987 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-09-09 06:35:50.715554 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-09-09 06:35:50.724991 I | ceph-object-controller: enabling rgw dashboard 2026-09-09 06:35:51.915720 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-09 06:35:52.823237 I | ceph-object-controller: creating COSI user "cosi" 2026-09-09 06:35:52.923149 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-09-09 06:35:53.433795 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:55.453682 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:100} {StateName:peering Count:2}]" 2026-09-09 06:35:55.459383 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:35:57.969302 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:100} {StateName:peering Count:2}]" 2026-09-09 06:35:57.973093 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:36:25.909037 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:105} {StateName:clean+premerge+peered Count:1}]" 2026-09-09 06:36:25.913249 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:36:28.493181 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:36:32.627858 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:36:56.411443 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:36:59.014098 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:37:18.739432 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:37:26.916224 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:37:29.562257 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:37:57.622586 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:38:00.105197 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:38:04.795071 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:38:28.130778 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:38:30.655771 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:38:50.922666 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:38:58.667535 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:39:01.156307 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:39:29.151083 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:39:31.656015 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:39:37.717482 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:39:59.683506 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:127} {StateName:peering Count:2}]" 2026-09-09 06:39:59.686612 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:40:02.162100 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:40:23.763434 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:40:30.217055 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:40:32.776669 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:41:00.742949 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:41:03.324665 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:158} {StateName:unknown Count:24} {StateName:peering Count:3}]" 2026-09-09 06:41:03.328722 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:41:09.750915 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:41:31.294824 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:41:33.787636 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:41:55.819185 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:42:01.841591 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:42:04.409666 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:42:32.390717 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:42:34.903997 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:42:41.869229 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:43:02.931965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:43:05.443592 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:43:27.929716 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:43:33.481965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:43:35.950066 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:44:04.008582 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:44:06.445913 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:44:14.015776 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:44:34.560014 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:44:36.942535 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:45:00.069287 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:45:05.089026 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:45:07.542435 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:45:35.625282 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:45:38.052835 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:45:46.146227 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:46:06.207968 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:46:08.880688 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:46:32.217058 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:46:36.678194 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:46:39.377565 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:47:07.249618 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:47:09.873971 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:47:18.231131 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:47:37.757574 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:47:40.408456 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:48:04.241602 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:48:08.299884 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:48:10.951374 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:48:38.818079 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:48:41.458333 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:48:50.248056 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:49:09.443221 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:49:12.069151 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:49:36.320892 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:49:39.970510 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:49:42.555373 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:50:10.472204 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:50:13.119349 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:50:22.452502 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:50:41.010089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:50:43.616677 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:51:08.533850 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:51:11.582514 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:51:14.151924 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:51:42.096770 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:51:44.666953 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:51:54.611071 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:52:12.641655 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:52:15.193032 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:52:40.628095 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:52:43.166694 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:52:45.702446 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:53:13.672126 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:53:16.227069 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:53:26.881785 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:53:44.182623 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:53:46.749403 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:54:12.997581 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:54:14.697268 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:54:17.293211 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:54:45.248019 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:54:47.783906 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:54:59.056124 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:55:15.745420 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:55:18.314467 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:55:45.148353 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:55:46.249359 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:55:48.872863 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:56:16.764347 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:56:19.371356 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:56:31.163500 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:56:47.258694 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:56:49.961979 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:57:17.257076 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:57:17.807978 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:57:20.529458 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:57:48.310650 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:57:51.062020 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:58:03.212175 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:58:18.905599 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:58:21.601171 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:58:49.959597 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:58:50.085890 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:58:52.293495 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:59:20.522884 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:59:22.856371 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:59:36.070755 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 06:59:51.039944 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 06:59:53.391827 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:00:22.457089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:00:23.095552 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:00:23.925197 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:00:52.938675 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:00:54.453099 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:01:09.175580 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:01:23.457540 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:01:24.977760 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:01:54.022897 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:01:55.924002 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:01:56.147649 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:02:24.503743 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:02:26.628844 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:02:41.931476 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:02:55.004386 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:02:57.177344 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:03:25.513618 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:03:28.568260 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:03:29.059868 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:03:56.100838 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:03:59.180607 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:04:15.170458 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:04:26.574644 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:04:29.702002 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:04:57.087707 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:05:00.166435 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:05:01.201073 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:05:27.668416 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:05:30.637079 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:05:47.321668 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:05:58.152330 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:06:01.218739 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:06:28.659595 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:06:31.741823 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:06:33.310660 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:06:59.206656 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:07:02.303888 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:07:19.397205 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:07:29.710224 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:07:32.792512 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:08:00.211116 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:08:03.299463 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:08:05.480872 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:08:30.727454 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:08:33.786784 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:08:51.507591 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:09:01.242338 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:09:04.311198 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:09:31.743212 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:09:34.818150 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:09:37.440366 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:10:02.224463 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:10:05.315665 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:10:23.594873 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:10:32.735857 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:10:35.859791 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:11:03.276957 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:11:06.415558 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:11:10.843891 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:11:33.789356 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:11:36.934235 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:11:56.963842 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:12:04.319744 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:12:07.524422 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:12:34.825093 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:12:38.028478 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:12:42.990034 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:13:05.385492 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:13:08.539100 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:13:29.120406 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:13:35.925683 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:13:39.012118 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:14:06.495488 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:14:09.520217 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:14:15.253839 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 07:14:36.995696 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:14:40.075430 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 07:15:01.249908 W | op-mon: external cluster mon count is 1, consider adding new monitors.