2026/09/09 01:25:06 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-09-09 01:25:06.808458 I | rookcmd: starting Rook v1.14.5 with arguments '/usr/local/bin/rook ceph operator' 2026-09-09 01:25:06.808483 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-09-09 01:25:06.808486 I | cephcmd: starting Rook-Ceph operator 2026-09-09 01:25:07.028034 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-09-09 01:25:07.037134 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-09-09 01:25:07.037168 I | operator: watching all namespaces for Ceph CRs 2026-09-09 01:25:07.037282 I | operator: setting up schemes 2026-09-09 01:25:07.042348 I | operator: setting up the controller-runtime manager 2026-09-09 01:25:07.043105 I | ceph-cluster-controller: successfully started 2026-09-09 01:25:07.050666 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-09-09 01:25:07.050875 I | ceph-cluster-controller: enabling hotplug orchestration 2026-09-09 01:25:07.050903 I | ceph-nodedaemon-controller: successfully started 2026-09-09 01:25:07.050921 I | ceph-block-pool-controller: successfully started 2026-09-09 01:25:07.050950 I | ceph-object-store-user-controller: successfully started 2026-09-09 01:25:07.050982 I | ceph-object-realm-controller: successfully started 2026-09-09 01:25:07.050996 I | ceph-object-zonegroup-controller: successfully started 2026-09-09 01:25:07.051036 I | ceph-object-zone-controller: successfully started 2026-09-09 01:25:07.051204 I | ceph-object-controller: successfully started 2026-09-09 01:25:07.051256 I | ceph-file-controller: successfully started 2026-09-09 01:25:07.051339 I | ceph-nfs-controller: successfully started 2026-09-09 01:25:07.051386 I | ceph-rbd-mirror-controller: successfully started 2026-09-09 01:25:07.051421 I | ceph-client-controller: successfully started 2026-09-09 01:25:07.051482 I | ceph-filesystem-mirror-controller: successfully started 2026-09-09 01:25:07.051532 I | operator: rook-ceph-operator-config-controller successfully started 2026-09-09 01:25:07.051553 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-09-09 01:25:07.051733 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-09-09 01:25:07.051762 I | ceph-bucket-topic: successfully started 2026-09-09 01:25:07.051777 I | ceph-bucket-notification: successfully started 2026-09-09 01:25:07.051797 I | ceph-bucket-notification: successfully started 2026-09-09 01:25:07.051808 I | ceph-fs-subvolumegroup-controller: successfully started 2026-09-09 01:25:07.051819 I | blockpool-rados-namespace-controller: successfully started 2026-09-09 01:25:07.051832 I | ceph-cosi-controller: successfully started 2026-09-09 01:25:07.051872 I | operator: starting the controller-runtime manager 2026-09-09 01:25:07.195450 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-09-09 01:25:07.259365 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-09-09 01:25:07.259398 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-09-09 01:25:07.259416 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-09-09 01:25:07.264425 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-09-09 01:25:07.264447 I | operator: rook-ceph-operator-config-controller done reconciling 2026-09-09 01:25:07.272611 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-09-09 01:25:07.272685 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-09-09 01:25:07.274282 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-09 01:25:07.274301 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-09 01:25:07.276689 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-09 01:25:07.283454 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-09 01:25:07.283474 I | ceph-csi: CSI CephFS driver disabled 2026-09-09 01:25:07.283481 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-09 01:25:07.286522 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-09 01:25:07.294301 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-09 01:25:07.294320 I | ceph-csi: CSI NFS driver disabled 2026-09-09 01:25:07.294327 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-09 01:25:07.297005 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-09 01:25:07.303808 I | ceph-csi: successfully removed CSI NFS driver 2026-09-09 01:25:28.801696 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-09-09 01:25:28.811608 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-09-09 01:25:28.812329 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-09-09 01:25:28.823736 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:25:28.823772 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:25:28.823897 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-09-09 01:25:28.823911 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-09-09 01:25:28.823918 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-09-09 01:25:28.824413 I | op-bucket-prov: successfully reconciled bucket provisioner I0909 01:25:28.824521 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-09-09 01:25:28.825920 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-09-09 01:25:28.837604 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-09-09 01:25:28.825984474 +0000 UTC m=+22.068904424 LastTransitionTime:2026-09-09 01:25:28.825984334 +0000 UTC m=+22.068904284}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again 2026-09-09 01:25:28.853500 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:25:28.853539 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:25:28.853563 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001895800] 2026-09-09 01:25:28.853584 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 01:25:29.007785 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-09-09 01:25:29.007812 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-09-09 01:25:29.607733 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:25:29.607765 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:25:29.808873 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-09-09 01:25:29.808929 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-09-09 01:25:29.808939 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-09-09 01:25:29.808953 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-09-09 01:25:29.808964 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-09-09 01:25:29.808974 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-09-09 01:25:29.808985 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-09-09 01:25:29.809003 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-09-09 01:25:29.809013 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-09-09 01:25:29.809025 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-09-09 01:25:29.809040 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-09-09 01:25:29.809051 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-09-09 01:25:29.809065 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-09-09 01:25:29.809083 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-09-09 01:25:29.809092 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-09-09 01:25:29.809101 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-09-09 01:25:29.811776 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-09-09 01:25:29.811798 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-09-09 01:25:29.811806 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-09-09 01:25:29.811812 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-09-09 01:25:29.811821 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 01:25:29.811828 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-09 01:25:29.811837 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 01:25:29.811846 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-09-09 01:25:29.811853 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-09-09 01:25:29.811860 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-09-09 01:25:29.811865 I | ceph-csi: Kubernetes version is 1.28 2026-09-09 01:25:29.811873 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-09-09 01:25:29.811887 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-09-09 01:25:29.811893 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-09-09 01:25:29.811899 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-09-09 01:25:29.811907 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-09-09 01:25:30.010402 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-09-09 01:25:30.010434 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.1" (configmap) 2026-09-09 01:25:30.010443 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.1" (configmap) 2026-09-09 01:25:30.010451 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.1" (configmap) 2026-09-09 01:25:30.010460 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.2" (configmap) 2026-09-09 01:25:30.010475 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.1" (configmap) 2026-09-09 01:25:30.010488 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-09-09 01:25:30.010497 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-09-09 01:25:30.010510 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-09-09 01:25:30.010517 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-09-09 01:25:30.010524 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-09-09 01:25:30.010531 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-09-09 01:25:30.010538 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-09-09 01:25:30.010545 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-09-09 01:25:30.010553 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-09-09 01:25:30.010560 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-09-09 01:25:30.010566 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-09-09 01:25:30.010573 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-09-09 01:25:30.010581 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-09-09 01:25:30.014968 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-09-09 01:25:30.014988 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-09-09 01:25:30.015005 I | ceph-csi: CSI Ceph RBD driver disabled 2026-09-09 01:25:30.015011 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-09-09 01:25:30.017535 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-09-09 01:25:30.210454 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-09-09 01:25:30.210481 I | ceph-csi: CSI CephFS driver disabled 2026-09-09 01:25:30.210490 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-09-09 01:25:30.213260 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-09-09 01:25:30.411129 I | ceph-csi: successfully removed CSI CephFS driver 2026-09-09 01:25:30.411154 I | ceph-csi: CSI NFS driver disabled 2026-09-09 01:25:30.411161 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-09-09 01:25:30.413676 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-09-09 01:25:30.612604 I | ceph-csi: successfully removed CSI NFS driver 2026-09-09 01:25:46.832460 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 01:25:46.832486 I | ceph-cluster-controller: validating ceph version from provided image 2026-09-09 01:25:46.846045 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:25:46.846069 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:25:46.849586 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-09-09 01:25:46.849679 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-09-09 01:25:47.376096 E | cephver: external cluster ceph version is a major version higher "18.2.8-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-09-09 01:25:47.911242 W | ceph-cluster-controller: image spec version 18.2.7-0 reef is lower than the running cluster version 18.2.8-0 reef, downgrading is not supported 2026-09-09 01:25:48.478465 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.7-0 reef" 2026-09-09 01:25:48.478489 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7" 2026-09-09 01:25:48.496651 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-09-09 01:25:48.499294 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-09-09 01:25:48.509136 I | ceph-cluster-controller: external cluster identity established 2026-09-09 01:25:48.509198 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-09-09 01:25:49.182129 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-09-09 01:25:50.497410 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-09-09 01:25:50.519894 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-09-09 01:25:50.519926 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-09-09 01:25:50.572440 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:25:52.099476 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-09-09 01:25:52.112486 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:25:53.514078 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-09-09 01:25:53.527066 I | ceph-cluster-controller: successfully updated csi config map 2026-09-09 01:25:53.527095 I | cephclient: getting or creating ceph auth key "client.crash" 2026-09-09 01:25:53.588034 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:25:54.102669 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-09-09 01:25:54.106228 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-09-09 01:25:54.106250 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-09-09 01:25:54.106257 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-09-09 01:25:58.902890 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:25:58.902920 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:25:58.902935 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 01:26:00.610701 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 01:26:02.026136 I | ceph-object-controller: reconciling object store deployments 2026-09-09 01:26:02.047703 I | ceph-object-controller: ceph object store gateway service running at 10.99.95.193 2026-09-09 01:26:02.047811 I | ceph-object-controller: reconciling object store pools 2026-09-09 01:26:05.177229 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-09 01:26:06.052667 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-09-09 01:26:06.052705 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-09-09 01:26:06.052715 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-09-09 01:26:08.270110 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-09-09 01:26:08.270150 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-09 01:26:12.347757 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-09 01:26:13.180790 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-09-09 01:26:13.180826 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-09-09 01:26:13.180834 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-09-09 01:26:15.390735 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-09-09 01:26:15.390768 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-09 01:26:21.423513 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:26:21.483089 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-09 01:26:22.522231 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-09-09 01:26:22.522266 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-09-09 01:26:22.522273 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-09-09 01:26:23.403263 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:17} {StateName:unknown Count:5} {StateName:creating+peering Count:3}]" 2026-09-09 01:26:23.408296 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:26:25.538621 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-09-09 01:26:25.538669 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-09 01:26:29.653799 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-09 01:26:30.513694 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-09-09 01:26:30.513723 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-09-09 01:26:30.513729 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-09-09 01:26:32.678767 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-09-09 01:26:32.678802 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-09 01:26:36.792065 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-09 01:26:37.653042 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-09-09 01:26:37.653075 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-09-09 01:26:37.653084 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-09-09 01:26:39.829553 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-09-09 01:26:39.829591 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-09 01:26:40.889751 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:26:44.927037 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-09 01:26:45.765208 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-09-09 01:26:45.765240 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-09-09 01:26:45.765248 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-09-09 01:26:47.999178 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-09-09 01:26:47.999210 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-09 01:26:52.783991 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:26:53.097006 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-09 01:26:54.715340 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-09-09 01:26:54.715373 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-09-09 01:26:54.715380 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-09-09 01:26:54.982818 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:49} {StateName:creating+peering Count:5} {StateName:unknown Count:3}]" 2026-09-09 01:26:54.985779 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:26:57.154630 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-09-09 01:26:57.154682 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-09 01:27:01.230408 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-09 01:27:01.989182 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-09-09 01:27:01.989213 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-09-09 01:27:01.989221 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-09-09 01:27:04.273951 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-09-09 01:27:04.273991 I | ceph-object-controller: configuring object store "ceph" 2026-09-09 01:27:04.978336 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-09 01:27:05.215010 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-09 01:27:05.712349 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-09 01:27:05.712432 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-09 01:27:05.717962 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-09 01:27:06.281847 I | ceph-object-controller: setting rgw config flags 2026-09-09 01:27:06.281884 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 01:27:06.959130 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 01:27:06.959169 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 01:27:07.376270 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 01:27:07.376308 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 01:27:07.794108 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 01:27:07.794147 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 01:27:08.260959 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 01:27:08.260993 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 01:27:08.724760 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 01:27:08.724800 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 01:27:09.103975 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 01:27:09.104414 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-09 01:27:09.173023 I | ceph-object-controller: enabling rgw dashboard 2026-09-09 01:27:11.033379 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-09 01:27:11.033968 I | ceph-object-controller: setting the dashboard api secret key 2026-09-09 01:27:11.539997 I | ceph-object-controller: done setting the dashboard api secret key 2026-09-09 01:27:23.378125 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:25.456281 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:26.934074 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:27:41.525609 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.99.95.193:80: i/o timeout 2026-09-09 01:27:41.551607 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-09-09 01:27:41.551647 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-09-09 01:27:41.551693 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-09-09 01:27:42.076000 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:58} {StateName:unknown Count:31}]" 2026-09-09 01:27:42.079853 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:42.575224 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:58} {StateName:unknown Count:31}]" 2026-09-09 01:27:42.580216 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:43.724017 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-09-09 01:27:45.084362 I | ceph-object-controller: reconciling object store deployments 2026-09-09 01:27:45.121131 I | ceph-object-controller: ceph object store gateway service running at 10.99.95.193 2026-09-09 01:27:45.121163 I | ceph-object-controller: reconciling object store pools 2026-09-09 01:27:46.430060 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-09-09 01:27:46.430089 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-09-09 01:27:47.285195 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-09-09 01:27:49.294844 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-09-09 01:27:49.294873 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-09-09 01:27:50.143704 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-09-09 01:27:52.340908 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-09-09 01:27:52.340942 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-09-09 01:27:53.274330 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-09-09 01:27:54.801995 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:56.498252 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-09-09 01:27:56.498288 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-09-09 01:27:56.700501 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:27:58.776253 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-09-09 01:28:01.565952 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-09-09 01:28:01.565976 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-09-09 01:28:02.430178 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-09-09 01:28:04.475048 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-09-09 01:28:04.475075 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-09-09 01:28:05.277929 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-09-09 01:28:07.628222 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-09-09 01:28:07.628904 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-09-09 01:28:08.473343 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-09-09 01:28:10.568560 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-09-09 01:28:10.568580 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-09-09 01:28:11.470266 I | ceph-object-controller: configuring object store "ceph" 2026-09-09 01:28:11.737156 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-09-09 01:28:11.924811 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-09-09 01:28:11.924845 I | ceph-object-controller: configuration for object-store ceph is complete 2026-09-09 01:28:11.924852 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-09-09 01:28:11.929869 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-09-09 01:28:13.113725 I | ceph-object-controller: setting rgw config flags 2026-09-09 01:28:13.113769 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 01:28:14.221937 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-09-09 01:28:14.221974 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 01:28:14.882282 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:28:15.125415 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-09-09 01:28:15.125457 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 01:28:15.518612 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-09-09 01:28:15.518659 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 01:28:15.965589 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-09-09 01:28:15.965631 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 01:28:16.339638 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-09-09 01:28:16.339761 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 01:28:16.727680 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-09-09 01:28:16.727853 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-09-09 01:28:16.740905 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-09-09 01:28:16.749799 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-09-09 01:28:16.754094 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-09-09 01:28:16.770277 I | ceph-object-controller: enabling rgw dashboard 2026-09-09 01:28:17.907624 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-09-09 01:28:19.155364 I | ceph-object-controller: creating COSI user "cosi" 2026-09-09 01:28:19.260837 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-09-09 01:28:19.786573 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:28:25.296750 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:28:27.274157 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:28:55.856282 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:28:57.785510 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:29:01.900416 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:29:26.353143 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:29:28.286793 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:29:48.076727 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:29:56.850532 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:29:58.859669 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:30:27.364844 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:30:29.357223 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:30:34.047951 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:30:57.915400 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:30:59.896002 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:31:20.065788 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:31:28.411337 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:31:30.442916 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:31:58.943000 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:32:00.984699 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:32:06.052876 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:32:29.519276 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:32:31.492484 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:32:52.121606 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:33:00.076475 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:33:01.988156 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:33:30.576238 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:33:32.486807 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:33:38.229250 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:34:01.137995 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:34:03.017857 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:34:24.303652 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:34:31.661712 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:34:33.495742 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:35:02.206759 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:35:04.013289 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:35:10.291767 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:35:32.704999 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:35:34.631073 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:35:56.288468 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:36:03.172220 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:36:05.141150 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:36:33.750464 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:36:35.636062 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:36:42.260943 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:37:04.238512 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:37:06.161672 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:37:28.255752 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:37:34.801575 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:37:36.635226 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:38:05.318071 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:38:07.345096 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:38:14.331691 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:38:35.821414 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:38:37.855632 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:39:00.304150 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:39:06.317356 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:39:08.358526 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:39:36.807434 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:39:38.841516 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:39:46.389695 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:40:07.298517 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:40:09.359513 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:40:32.410187 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:40:37.768865 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:40:39.892596 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:41:08.340453 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:41:10.411045 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:41:18.412799 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:41:38.946227 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:41:41.050952 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:42:04.473901 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:42:09.468889 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:42:11.523486 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:42:40.019696 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:42:42.029505 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:42:50.528784 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:43:10.538976 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:43:12.501846 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:43:36.509870 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:43:41.053112 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:43:43.054944 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:44:11.562363 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:44:13.605060 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:44:22.581062 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:44:42.104919 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:44:44.116877 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:45:08.603291 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:45:12.602293 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:45:14.652547 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:45:43.149558 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:45:45.189539 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:45:54.589742 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:46:13.645510 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:46:15.753750 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:46:40.643653 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:46:44.230927 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:46:46.321097 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:47:14.703318 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:47:16.814068 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:47:26.580907 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:47:45.190072 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:47:47.310274 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:48:12.603160 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:48:15.674942 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:48:17.816066 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:48:46.227342 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:48:48.260247 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:48:58.829268 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:49:16.691528 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:49:18.835593 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:49:44.796030 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:49:47.172708 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:49:49.318386 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:50:17.696046 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:50:19.921581 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:50:30.753182 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:50:48.230710 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:50:50.460940 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:51:16.835768 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:51:18.725169 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:51:20.982916 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:51:49.265878 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:51:51.463824 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:52:02.850695 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:52:19.788815 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:52:22.028318 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:52:48.882858 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:52:50.346788 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:52:52.520419 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:53:20.843661 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:53:23.103289 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:53:34.945469 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:53:51.351213 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:53:53.599831 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:54:21.060896 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:54:21.877789 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:54:24.166441 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:54:52.390246 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:54:54.680337 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:55:07.181293 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:55:22.974828 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:55:25.235885 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:55:53.392507 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:55:53.840735 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:55:55.783388 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:56:24.375246 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:56:26.268805 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:56:39.418068 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:56:54.876423 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:56:56.815320 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:57:26.411348 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:57:26.494481 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:57:27.348848 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:57:56.990776 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:57:57.828257 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:58:12.751803 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:58:27.468594 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:58:28.350288 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:58:58.182544 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:58:59.799314 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:58:59.971734 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:59:28.687747 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:59:30.361144 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 01:59:45.988884 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 01:59:59.168506 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:00:00.841229 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:00:29.674150 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:00:31.915388 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:00:32.577796 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:01:00.130065 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:01:02.458826 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:01:18.571124 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:01:30.611356 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:01:32.950663 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:02:01.161027 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:02:03.435210 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:02:04.604467 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:02:31.685248 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:02:33.893291 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:02:50.561391 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:03:02.210877 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:03:04.371434 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:03:32.707994 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:03:34.878688 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:03:36.569192 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:04:03.202936 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:04:05.359583 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:04:22.563336 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:04:33.782768 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:04:35.870282 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:05:04.271681 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:05:06.413660 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:05:08.596793 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:05:34.772906 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:05:36.966841 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:05:54.736061 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-09-09 02:06:05.299897 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:06:07.466348 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:06:35.825461 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:06:37.994299 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-09-09 02:06:42.728635 W | op-mon: external cluster mon count is 1, consider adding new monitors.