2026/05/19 16:05:56 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-05-19 16:05:56.359754 I | rookcmd: starting Rook v1.14.2 with arguments '/usr/local/bin/rook ceph operator' 2026-05-19 16:05:56.359788 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-05-19 16:05:56.359792 I | cephcmd: starting Rook-Ceph operator 2026-05-19 16:05:56.528326 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-05-19 16:05:56.535148 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-05-19 16:05:56.535176 I | operator: watching all namespaces for Ceph CRs 2026-05-19 16:05:56.535279 I | operator: setting up schemes 2026-05-19 16:05:56.539003 I | operator: setting up the controller-runtime manager 2026-05-19 16:05:56.539517 I | ceph-cluster-controller: successfully started 2026-05-19 16:05:56.541994 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-05-19 16:05:56.542009 I | ceph-cluster-controller: enabling hotplug orchestration 2026-05-19 16:05:56.542033 I | ceph-nodedaemon-controller: successfully started 2026-05-19 16:05:56.542046 I | ceph-block-pool-controller: successfully started 2026-05-19 16:05:56.542065 I | ceph-object-store-user-controller: successfully started 2026-05-19 16:05:56.542081 I | ceph-object-realm-controller: successfully started 2026-05-19 16:05:56.542093 I | ceph-object-zonegroup-controller: successfully started 2026-05-19 16:05:56.542109 I | ceph-object-zone-controller: successfully started 2026-05-19 16:05:56.542218 I | ceph-object-controller: successfully started 2026-05-19 16:05:56.542293 I | ceph-file-controller: successfully started 2026-05-19 16:05:56.542325 I | ceph-nfs-controller: successfully started 2026-05-19 16:05:56.542349 I | ceph-rbd-mirror-controller: successfully started 2026-05-19 16:05:56.542375 I | ceph-client-controller: successfully started 2026-05-19 16:05:56.542391 I | ceph-filesystem-mirror-controller: successfully started 2026-05-19 16:05:56.542410 I | operator: rook-ceph-operator-config-controller successfully started 2026-05-19 16:05:56.542428 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-05-19 16:05:56.542529 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-05-19 16:05:56.542555 I | ceph-bucket-topic: successfully started 2026-05-19 16:05:56.542568 I | ceph-bucket-notification: successfully started 2026-05-19 16:05:56.542590 I | ceph-bucket-notification: successfully started 2026-05-19 16:05:56.542605 I | ceph-fs-subvolumegroup-controller: successfully started 2026-05-19 16:05:56.542621 I | blockpool-rados-namespace-controller: successfully started 2026-05-19 16:05:56.542630 I | ceph-cosi-controller: successfully started 2026-05-19 16:05:56.542651 I | operator: starting the controller-runtime manager 2026-05-19 16:05:56.735508 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-05-19 16:05:56.771360 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-05-19 16:05:56.771400 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-05-19 16:05:56.771425 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-05-19 16:05:56.775008 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-05-19 16:05:56.775032 I | operator: rook-ceph-operator-config-controller done reconciling 2026-05-19 16:05:56.800307 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-05-19 16:05:56.802002 I | ceph-csi: CSI Ceph RBD driver disabled 2026-05-19 16:05:56.802030 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-05-19 16:05:56.804123 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-05-19 16:05:56.810326 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-05-19 16:05:56.810344 I | ceph-csi: CSI CephFS driver disabled 2026-05-19 16:05:56.810349 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-05-19 16:05:56.812578 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-05-19 16:05:56.818225 I | ceph-csi: successfully removed CSI CephFS driver 2026-05-19 16:05:56.818240 I | ceph-csi: CSI NFS driver disabled 2026-05-19 16:05:56.818245 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-05-19 16:05:56.820139 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-05-19 16:05:56.843739 I | ceph-csi: successfully removed CSI NFS driver 2026-05-19 16:06:18.777021 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-05-19 16:06:18.784471 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-05-19 16:06:18.788747 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-05-19 16:06:18.801001 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-05-19 16:06:18.803028 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:06:18.803047 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:06:18.803109 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-05-19 16:06:18.803115 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-05-19 16:06:18.803119 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-05-19 16:06:18.803553 I | op-bucket-prov: successfully reconciled bucket provisioner I0519 16:06:18.803643 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-05-19 16:06:18.806126 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-05-19 16:06:18.817868 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-05-19 16:06:18.80618219 +0000 UTC m=+22.512232251 LastTransitionTime:2026-05-19 16:06:18.8061821 +0000 UTC m=+22.512232161}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again 2026-05-19 16:06:18.818324 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-05-19 16:06:18.818343 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-05-19 16:06:18.821543 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:06:18.821562 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:06:18.984693 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:06:18.984730 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:06:18.984765 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001796060] 2026-05-19 16:06:18.984788 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-05-19 16:06:19.189684 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-05-19 16:06:19.189707 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-05-19 16:06:19.189710 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-05-19 16:06:19.189715 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-05-19 16:06:19.189720 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-05-19 16:06:19.189723 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-05-19 16:06:19.189727 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-05-19 16:06:19.189732 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-05-19 16:06:19.189736 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-05-19 16:06:19.189739 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-05-19 16:06:19.189742 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-05-19 16:06:19.189745 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-05-19 16:06:19.189752 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-05-19 16:06:19.189756 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-05-19 16:06:19.189759 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-05-19 16:06:19.189762 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-05-19 16:06:19.192152 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-05-19 16:06:19.192162 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-05-19 16:06:19.192166 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-05-19 16:06:19.192168 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-05-19 16:06:19.192172 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-05-19 16:06:19.192176 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-05-19 16:06:19.192179 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-05-19 16:06:19.192183 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-05-19 16:06:19.192186 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-05-19 16:06:19.192189 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-05-19 16:06:19.192192 I | ceph-csi: Kubernetes version is 1.28 2026-05-19 16:06:19.192195 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-05-19 16:06:19.192198 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-05-19 16:06:19.192201 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-05-19 16:06:19.192204 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-05-19 16:06:19.192207 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-05-19 16:06:19.587014 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-05-19 16:06:19.587051 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0" (configmap) 2026-05-19 16:06:19.587058 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.0" (configmap) 2026-05-19 16:06:19.587063 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.0" (configmap) 2026-05-19 16:06:19.587068 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.1" (configmap) 2026-05-19 16:06:19.587080 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.0" (configmap) 2026-05-19 16:06:19.587090 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-05-19 16:06:19.587098 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-05-19 16:06:19.587108 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-05-19 16:06:19.587117 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-05-19 16:06:19.587122 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-05-19 16:06:19.587128 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-05-19 16:06:19.587132 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-05-19 16:06:19.587137 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-05-19 16:06:19.587141 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-05-19 16:06:19.587148 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-05-19 16:06:19.587152 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-05-19 16:06:19.587156 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-05-19 16:06:19.587161 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-05-19 16:06:19.589626 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-05-19 16:06:19.589645 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-05-19 16:06:19.589651 I | ceph-csi: CSI Ceph RBD driver disabled 2026-05-19 16:06:19.589658 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-05-19 16:06:19.592181 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-05-19 16:06:19.998983 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-05-19 16:06:19.999008 I | ceph-csi: CSI CephFS driver disabled 2026-05-19 16:06:19.999014 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-05-19 16:06:20.003638 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-05-19 16:06:20.186888 I | ceph-csi: successfully removed CSI CephFS driver 2026-05-19 16:06:20.186918 I | ceph-csi: CSI NFS driver disabled 2026-05-19 16:06:20.186927 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-05-19 16:06:20.189271 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-05-19 16:06:20.388452 I | ceph-csi: successfully removed CSI NFS driver 2026-05-19 16:06:57.247078 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-05-19 16:06:57.247124 I | ceph-cluster-controller: validating ceph version from provided image 2026-05-19 16:06:57.710045 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:06:57.710103 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:06:57.752761 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-05-19 16:06:57.753005 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-05-19 16:06:58.359926 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-05-19 16:06:59.137772 W | ceph-cluster-controller: image spec version 18.2.1-0 reef is lower than the running cluster version 18.2.7-0 reef, downgrading is not supported 2026-05-19 16:07:01.065254 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.1-0 reef" 2026-05-19 16:07:01.065308 I | ceph-cluster-controller: cluster "openstack": version "18.2.1-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1" 2026-05-19 16:07:01.074657 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-05-19 16:07:01.074685 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-05-19 16:07:01.093714 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:07:01.096194 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-05-19 16:07:01.100234 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-05-19 16:07:01.121354 I | ceph-cluster-controller: external cluster identity established 2026-05-19 16:07:01.121406 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-05-19 16:07:02.423582 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:07:02.506119 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-05-19 16:07:03.815689 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-05-19 16:07:03.908040 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:07:04.537103 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-05-19 16:07:05.210950 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-05-19 16:07:05.225540 I | ceph-cluster-controller: successfully updated csi config map 2026-05-19 16:07:05.225565 I | cephclient: getting or creating ceph auth key "client.crash" 2026-05-19 16:07:05.903116 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-05-19 16:07:05.970916 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-05-19 16:07:05.970978 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-05-19 16:07:05.970986 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-05-19 16:07:13.612145 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:07:13.612269 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:07:13.612319 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-05-19 16:07:16.276835 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-05-19 16:07:19.371299 I | ceph-object-controller: reconciling object store deployments 2026-05-19 16:07:21.911519 I | ceph-object-controller: ceph object store gateway service running at 10.108.97.86 2026-05-19 16:07:21.911575 I | ceph-object-controller: reconciling object store pools 2026-05-19 16:07:29.449439 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-05-19 16:07:30.531934 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-05-19 16:07:30.531963 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-05-19 16:07:30.531968 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-05-19 16:07:31.894712 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:unknown Count:8} {StateName:active+clean Count:1}]" 2026-05-19 16:07:31.901355 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:07:32.759238 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-05-19 16:07:32.759282 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-05-19 16:07:33.407625 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:07:38.229332 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-05-19 16:07:39.174944 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-05-19 16:07:39.174973 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-05-19 16:07:39.174978 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-05-19 16:07:42.867691 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-05-19 16:07:42.867799 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-05-19 16:07:49.330307 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-05-19 16:07:50.599074 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-05-19 16:07:50.599104 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-05-19 16:07:50.599110 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-05-19 16:07:53.070517 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:07:56.079653 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-05-19 16:07:56.079715 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-05-19 16:08:03.248259 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:08:04.303215 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:08:11.018932 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-05-19 16:08:13.296197 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-05-19 16:08:13.296230 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-05-19 16:08:13.296236 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-05-19 16:08:16.367803 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-05-19 16:08:16.367855 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-05-19 16:08:23.310069 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-05-19 16:08:24.549371 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-05-19 16:08:24.549403 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-05-19 16:08:24.549416 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-05-19 16:08:28.246056 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-05-19 16:08:28.246102 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-05-19 16:08:34.248158 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:08:34.816958 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-05-19 16:08:35.142969 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:65} {StateName:unknown Count:8}]" 2026-05-19 16:08:35.148500 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:08:36.002615 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-05-19 16:08:36.002655 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-05-19 16:08:36.002662 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-05-19 16:08:39.692292 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:08:40.120192 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-05-19 16:08:40.120235 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-05-19 16:08:53.629859 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-05-19 16:08:54.617711 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-05-19 16:08:54.617748 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-05-19 16:08:54.617760 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-05-19 16:08:56.680383 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-05-19 16:08:56.680427 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-05-19 16:09:00.940640 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-05-19 16:09:01.940797 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-05-19 16:09:01.940836 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-05-19 16:09:01.940843 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-05-19 16:09:04.116166 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-05-19 16:09:04.116212 I | ceph-object-controller: configuring object store "ceph" 2026-05-19 16:09:04.989929 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:81} {StateName:creating+peering Count:1}]" 2026-05-19 16:09:05.063114 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:05.794499 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:81} {StateName:creating+peering Count:1}]" 2026-05-19 16:09:05.975736 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:08.075641 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-05-19 16:09:08.515212 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-05-19 16:09:10.455628 I | ceph-object-controller: configuration for object-store ceph is complete 2026-05-19 16:09:10.455663 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-05-19 16:09:10.459701 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-05-19 16:09:11.128323 I | ceph-object-controller: setting rgw config flags 2026-05-19 16:09:11.128356 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-05-19 16:09:11.666035 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-05-19 16:09:11.666083 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-05-19 16:09:12.613955 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-05-19 16:09:12.613998 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-05-19 16:09:13.711891 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-05-19 16:09:13.711948 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-05-19 16:09:14.662734 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-05-19 16:09:14.662768 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-05-19 16:09:15.198448 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-05-19 16:09:15.198509 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-05-19 16:09:15.713756 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-05-19 16:09:15.714255 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-05-19 16:09:16.019261 I | ceph-object-controller: enabling rgw dashboard 2026-05-19 16:09:18.466623 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-05-19 16:09:18.467588 I | ceph-object-controller: setting the dashboard api secret key 2026-05-19 16:09:19.207424 I | ceph-object-controller: done setting the dashboard api secret key 2026-05-19 16:09:26.446085 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:09:35.738285 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:36.650202 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:49.484904 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.108.97.86:80: i/o timeout 2026-05-19 16:09:49.507877 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-05-19 16:09:49.507910 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-05-19 16:09:49.507925 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-05-19 16:09:50.142348 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:clean+premerge+peered Count:1} {StateName:peering Count:1}]" 2026-05-19 16:09:50.147045 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:50.761300 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:clean+premerge+peered Count:1} {StateName:peering Count:1}]" 2026-05-19 16:09:50.766400 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:09:51.752230 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-05-19 16:09:53.410532 I | ceph-object-controller: reconciling object store deployments 2026-05-19 16:09:53.658307 I | ceph-object-controller: ceph object store gateway service running at 10.108.97.86 2026-05-19 16:09:53.658339 I | ceph-object-controller: reconciling object store pools 2026-05-19 16:09:55.130533 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-05-19 16:09:55.130581 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-05-19 16:09:56.344101 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-05-19 16:09:58.789221 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-05-19 16:09:58.789314 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-05-19 16:09:59.811900 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-05-19 16:10:02.807710 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-05-19 16:10:02.807763 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-05-19 16:10:03.887621 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-05-19 16:10:07.023475 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:10:08.007564 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-05-19 16:10:08.007602 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-05-19 16:10:08.322717 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:10:09.156277 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-05-19 16:10:13.822256 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-05-19 16:10:13.822351 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-05-19 16:10:14.228852 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:10:15.798827 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-05-19 16:10:18.794954 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-05-19 16:10:18.794987 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-05-19 16:10:19.796619 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-05-19 16:10:22.547911 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-05-19 16:10:22.547955 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-05-19 16:10:23.520138 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-05-19 16:10:25.660937 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-05-19 16:10:25.660977 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-05-19 16:10:26.641974 I | ceph-object-controller: configuring object store "ceph" 2026-05-19 16:10:27.029961 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-05-19 16:10:27.245453 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-05-19 16:10:27.245499 I | ceph-object-controller: configuration for object-store ceph is complete 2026-05-19 16:10:27.245509 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-05-19 16:10:27.250612 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-05-19 16:10:27.934423 I | ceph-object-controller: setting rgw config flags 2026-05-19 16:10:27.934467 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-05-19 16:10:28.678604 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-05-19 16:10:28.678652 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-05-19 16:10:29.187756 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-05-19 16:10:29.187795 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-05-19 16:10:29.663179 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-05-19 16:10:29.663230 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-05-19 16:10:30.153764 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-05-19 16:10:30.153818 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-05-19 16:10:30.637741 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-05-19 16:10:30.637780 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-05-19 16:10:31.108195 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-05-19 16:10:31.108570 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-05-19 16:10:31.125518 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-05-19 16:10:31.136297 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-05-19 16:10:31.140306 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-05-19 16:10:31.145987 I | ceph-object-controller: enabling rgw dashboard 2026-05-19 16:10:32.334459 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-05-19 16:10:34.336735 I | ceph-object-controller: creating COSI user "cosi" 2026-05-19 16:10:34.434232 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-05-19 16:10:35.092117 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:104} {StateName:unknown Count:8}]" 2026-05-19 16:10:35.098363 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:10:37.606623 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:10:39.010778 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:11:00.406870 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:11:08.235176 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:11:09.590703 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:11:38.841352 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:11:40.213880 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:11:47.315314 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:12:09.456346 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:12:10.854646 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:12:33.610207 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:12:40.200660 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:12:42.231896 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:13:10.825000 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:13:12.856402 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:13:19.907319 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:13:41.423141 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:13:44.075035 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:14:06.745118 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:14:12.007732 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:14:14.658182 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:14:42.612969 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:14:45.236601 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:14:52.921486 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:15:13.219003 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:15:15.832594 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:15:39.152832 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:15:43.882906 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:15:46.424917 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:16:14.575674 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:16:17.020349 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:16:26.295442 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:16:45.160505 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:16:47.582478 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:17:12.473584 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:17:15.771409 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:17:18.176700 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:17:46.365324 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:17:48.764868 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:17:58.652008 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:18:16.924748 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:18:19.343014 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:18:44.803140 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:18:47.511543 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:18:49.906377 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:19:18.105454 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:19:20.534888 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:19:30.988209 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:19:48.695884 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:19:51.103549 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:20:17.481869 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:20:19.251404 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:20:21.686183 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:20:49.828810 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:20:53.463636 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:21:03.680735 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:21:20.494309 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:21:24.033775 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:21:49.862527 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:21:51.059996 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:21:54.640068 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:22:21.622328 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:22:25.292797 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:22:36.050788 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:22:52.194216 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:22:55.867605 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:23:22.183085 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:23:22.787001 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:23:26.450411 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:23:53.352374 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:23:57.030164 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:24:08.342573 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:24:23.936099 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:24:27.584922 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:24:55.201992 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:24:55.203557 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:24:58.142155 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:25:25.852743 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:25:28.719711 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:25:41.369664 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:25:56.458738 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:25:59.300793 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:26:27.795690 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:26:28.245459 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:26:29.907431 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:26:58.354795 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:27:00.497134 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:27:14.502410 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:27:28.932145 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:27:31.087329 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:28:00.104171 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:28:01.493678 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:28:01.960857 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:28:30.700297 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:28:32.522227 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:28:47.648992 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:29:01.368254 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:29:03.127414 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:29:31.980481 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:29:34.852268 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:29:34.857279 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:30:02.687881 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:30:05.596472 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:30:21.076291 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:30:33.356363 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:30:36.175374 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:31:03.951896 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:31:07.508951 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:31:08.015464 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:31:34.613295 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:31:38.145499 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:31:54.237968 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:32:05.196450 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:32:08.743100 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:32:35.776133 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:32:39.435621 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:32:40.551178 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:33:06.413425 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:33:10.065889 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:33:26.713057 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:33:37.017758 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:33:40.649158 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:34:07.607310 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:34:11.255306 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:34:12.938802 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:34:38.235039 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:34:41.859039 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:34:59.139713 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:35:08.818895 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:35:12.460178 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:35:39.424736 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:35:50.463159 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:35:53.521131 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:36:09.975336 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:36:21.073339 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:36:39.665724 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:36:40.547550 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:36:51.652567 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:37:11.142588 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:37:22.245219 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:37:25.847861 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:37:41.715622 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:37:52.815472 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:38:12.435707 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:38:12.674081 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:38:23.426131 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:38:43.301606 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:38:54.017839 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:38:58.619588 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:39:13.859854 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:39:24.579177 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:39:45.222432 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:39:48.957896 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:40:11.676402 E | ceph-cluster-controller: failed to get ceph status. failed to get status. . timed out: exit status 1 2026-05-19 16:40:39.978888 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:40:42.766805 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:40:43.003480 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:41:31.781448 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:41:32.179059 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:41:36.799076 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:42:02.389172 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:42:07.394585 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:42:18.428900 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:42:32.976674 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:42:37.987197 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:43:03.699449 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:43:04.768374 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:43:08.598461 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:43:34.291472 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:43:39.194441 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:43:50.988117 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:44:04.896124 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:44:09.891294 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:44:35.475597 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:44:37.249456 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:44:40.471312 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:45:06.050454 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:45:11.048097 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:45:23.482192 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:45:36.645767 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:45:41.653251 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:46:07.197580 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:46:09.648978 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:46:12.235820 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:46:37.766814 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:46:42.808875 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:46:55.863109 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-05-19 16:47:08.384120 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-05-19 16:47:13.428817 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0