2026/03/19 22:07:06 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-03-19 22:07:06.808435 I | rookcmd: starting Rook v1.15.9 with arguments '/usr/local/bin/rook ceph operator' 2026-03-19 22:07:06.808456 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-03-19 22:07:06.808459 I | cephcmd: starting Rook-Ceph operator 2026-03-19 22:07:06.909643 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.4 (e7ad5345525c7aa95470c26863873b581076945d) reef (stable)" 2026-03-19 22:07:06.917589 I | op-k8sutil: operator setting "ROOK_CSIADDONS_IMAGE" = "quay.io/csiaddons/k8s-sidecar:v0.9.1" 2026-03-19 22:07:06.917619 I | op-k8sutil: operator setting "ROOK_CSI_SNAPSHOTTER_IMAGE" = "registry.k8s.io/sig-storage/csi-snapshotter:v8.0.1" 2026-03-19 22:07:06.917630 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_NFS" = "false" 2026-03-19 22:07:06.917639 I | op-k8sutil: operator setting "ROOK_CSI_PROVISIONER_IMAGE" = "registry.k8s.io/sig-storage/csi-provisioner:v5.0.1" 2026-03-19 22:07:06.917646 I | op-k8sutil: operator setting "ROOK_CSI_RESIZER_IMAGE" = "registry.k8s.io/sig-storage/csi-resizer:v1.11.1" 2026-03-19 22:07:06.917652 I | op-k8sutil: operator setting "CSI_NFS_FSGROUPPOLICY" = "File" 2026-03-19 22:07:06.917658 I | op-k8sutil: operator setting "CSI_RBD_FSGROUPPOLICY" = "File" 2026-03-19 22:07:06.917664 I | op-k8sutil: operator setting "ROOK_CEPH_ALLOW_LOOP_DEVICES" = "false" 2026-03-19 22:07:06.917670 I | op-k8sutil: operator setting "ROOK_CSI_ATTACHER_IMAGE" = "registry.k8s.io/sig-storage/csi-attacher:v4.6.1" 2026-03-19 22:07:06.917676 I | op-k8sutil: operator setting "ROOK_ENABLE_DISCOVERY_DAEMON" = "false" 2026-03-19 22:07:06.917683 I | op-k8sutil: operator setting "CSI_ENABLE_NFS_SNAPSHOTTER" = "true" 2026-03-19 22:07:06.917689 I | op-k8sutil: operator setting "CSI_ENABLE_VOLUME_GROUP_SNAPSHOT" = "true" 2026-03-19 22:07:06.917712 I | op-k8sutil: operator setting "CSI_RBD_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-resizer\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-attacher\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-snapshotter\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-rbdplugin\n resource:\n requests:\n memory: 512Mi\n limits:\n memory: 1Gi\n- name : csi-omap-generator\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n- name : liveness-prometheus\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n" 2026-03-19 22:07:06.917733 I | op-k8sutil: operator setting "ROOK_CSI_REGISTRAR_IMAGE" = "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.11.1" 2026-03-19 22:07:06.917739 I | op-k8sutil: operator setting "CSI_FORCE_CEPHFS_KERNEL_CLIENT" = "true" 2026-03-19 22:07:06.917748 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_RBD" = "false" 2026-03-19 22:07:06.917754 I | op-k8sutil: operator setting "ROOK_OBC_WATCH_OPERATOR_NAMESPACE" = "true" 2026-03-19 22:07:06.917766 I | op-k8sutil: operator setting "CSI_ENABLE_HOST_NETWORK" = "true" 2026-03-19 22:07:06.917771 I | op-k8sutil: operator setting "CSI_NFS_ATTACH_REQUIRED" = "true" 2026-03-19 22:07:06.917777 I | op-k8sutil: operator setting "ROOK_LOG_LEVEL" = "INFO" 2026-03-19 22:07:06.917784 I | op-k8sutil: operator setting "CSI_RBD_ATTACH_REQUIRED" = "true" 2026-03-19 22:07:06.917795 I | op-k8sutil: operator setting "ROOK_CSI_DISABLE_DRIVER" = "false" 2026-03-19 22:07:06.917810 I | op-k8sutil: operator setting "CSI_CEPHFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n- name : csi-cephfsplugin\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n- name : liveness-prometheus\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n" 2026-03-19 22:07:06.917823 I | op-k8sutil: operator setting "CSI_ENABLE_CEPHFS_SNAPSHOTTER" = "true" 2026-03-19 22:07:06.917830 I | op-k8sutil: operator setting "CSI_ENABLE_OMAP_GENERATOR" = "false" 2026-03-19 22:07:06.917858 I | op-k8sutil: operator setting "CSI_NFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n- name : csi-nfsplugin\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n" 2026-03-19 22:07:06.917877 I | op-k8sutil: operator setting "CSI_NFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-nfsplugin\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n- name : csi-attacher\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n" 2026-03-19 22:07:06.917889 I | op-k8sutil: operator setting "CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT" = "false" 2026-03-19 22:07:06.917935 I | op-k8sutil: operator setting "CSI_PROVISIONER_PRIORITY_CLASSNAME" = "system-cluster-critical" 2026-03-19 22:07:06.917974 I | op-k8sutil: operator setting "CSI_RBD_PLUGIN_RESOURCE" = "- name : driver-registrar\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n- name : csi-rbdplugin\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n- name : liveness-prometheus\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n" 2026-03-19 22:07:06.918021 I | op-k8sutil: operator setting "CSI_CEPHFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-resizer\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-attacher\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-snapshotter\n resource:\n requests:\n memory: 128Mi\n cpu: 100m\n limits:\n memory: 256Mi\n- name : csi-cephfsplugin\n resource:\n requests:\n memory: 512Mi\n cpu: 250m\n limits:\n memory: 1Gi\n- name : liveness-prometheus\n resource:\n requests:\n memory: 128Mi\n cpu: 50m\n limits:\n memory: 256Mi\n" 2026-03-19 22:07:06.918039 I | op-k8sutil: operator setting "CSI_ENABLE_CSIADDONS" = "false" 2026-03-19 22:07:06.918049 I | op-k8sutil: operator setting "CSI_ENABLE_RBD_SNAPSHOTTER" = "true" 2026-03-19 22:07:06.918063 I | op-k8sutil: operator setting "CSI_GRPC_TIMEOUT_SECONDS" = "150" 2026-03-19 22:07:06.918072 I | op-k8sutil: operator setting "ROOK_CSI_IMAGE_PULL_POLICY" = "IfNotPresent" 2026-03-19 22:07:06.918080 I | op-k8sutil: operator setting "CSI_ENABLE_METADATA" = "false" 2026-03-19 22:07:06.918093 I | op-k8sutil: operator setting "CSI_ENABLE_TOPOLOGY" = "false" 2026-03-19 22:07:06.918101 I | op-k8sutil: operator setting "CSI_PLUGIN_PRIORITY_CLASSNAME" = "system-node-critical" 2026-03-19 22:07:06.918109 I | op-k8sutil: operator setting "CSI_PROVISIONER_REPLICAS" = "2" 2026-03-19 22:07:06.918126 I | op-k8sutil: operator setting "CSI_CEPHFS_ATTACH_REQUIRED" = "true" 2026-03-19 22:07:06.918134 I | op-k8sutil: operator setting "CSI_CEPHFS_FSGROUPPOLICY" = "File" 2026-03-19 22:07:06.918158 I | op-k8sutil: operator setting "CSI_DISABLE_HOLDER_PODS" = "true" 2026-03-19 22:07:06.918167 I | op-k8sutil: operator setting "CSI_ENABLE_ENCRYPTION" = "false" 2026-03-19 22:07:06.918181 I | op-k8sutil: operator setting "ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS" = "15" 2026-03-19 22:07:06.918190 I | op-k8sutil: operator setting "ROOK_CSI_CEPH_IMAGE" = "quay.io/cephcsi/cephcsi:v3.12.3" 2026-03-19 22:07:06.918204 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_CEPHFS" = "false" 2026-03-19 22:07:06.918213 I | operator: watching all namespaces for Ceph CRs 2026-03-19 22:07:06.918342 I | operator: setting up schemes 2026-03-19 22:07:06.921816 I | operator: setting up the controller-runtime manager 2026-03-19 22:07:06.922249 I | ceph-cluster-controller: successfully started 2026-03-19 22:07:06.922598 I | ceph-cluster-controller: enabling hotplug orchestration 2026-03-19 22:07:06.922620 I | ceph-nodedaemon-controller: successfully started 2026-03-19 22:07:06.922630 I | ceph-block-pool-controller: successfully started 2026-03-19 22:07:06.922644 I | ceph-object-store-user-controller: successfully started 2026-03-19 22:07:06.922668 I | ceph-object-realm-controller: successfully started 2026-03-19 22:07:06.922677 I | ceph-object-zonegroup-controller: successfully started 2026-03-19 22:07:06.922688 I | ceph-object-zone-controller: successfully started 2026-03-19 22:07:06.922766 I | ceph-object-controller: successfully started 2026-03-19 22:07:06.922795 I | ceph-file-controller: successfully started 2026-03-19 22:07:06.922814 I | ceph-nfs-controller: successfully started 2026-03-19 22:07:06.922838 I | ceph-rbd-mirror-controller: successfully started 2026-03-19 22:07:06.922862 I | ceph-client-controller: successfully started 2026-03-19 22:07:06.922883 I | ceph-filesystem-mirror-controller: successfully started 2026-03-19 22:07:06.922907 I | operator: rook-ceph-operator-config-controller successfully started 2026-03-19 22:07:06.922919 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-03-19 22:07:06.923052 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-03-19 22:07:06.923070 I | ceph-bucket-topic: successfully started 2026-03-19 22:07:06.923078 I | ceph-bucket-notification: successfully started 2026-03-19 22:07:06.923085 I | ceph-bucket-notification: successfully started 2026-03-19 22:07:06.923092 I | ceph-fs-subvolumegroup-controller: successfully started 2026-03-19 22:07:06.923143 I | blockpool-rados-namespace-controller: successfully started 2026-03-19 22:07:06.923193 I | ceph-cosi-controller: successfully started 2026-03-19 22:07:06.923209 I | operator: starting the controller-runtime manager 2026-03-19 22:07:07.137824 I | operator: rook-ceph-operator-config-controller done reconciling 2026-03-19 22:07:07.143351 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-03-19 22:07:07.146486 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-03-19 22:07:07.149029 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-03-19 22:07:07.156364 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-03-19 22:07:07.156382 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-03-19 22:07:07.158256 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-03-19 22:07:07.164953 I | ceph-csi: successfully removed CSI CephFS driver 2026-03-19 22:07:07.164974 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-03-19 22:07:07.167181 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-03-19 22:07:07.171858 I | ceph-csi: successfully removed CSI NFS driver 2026-03-19 22:07:28.675058 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-03-19 22:07:28.678976 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-03-19 22:07:28.683743 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-03-19 22:07:28.696986 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-19 22:07:28.697181 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-19 22:07:28.697319 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-03-19 22:07:28.697715 I | op-bucket-prov: successfully reconciled bucket provisioner I0319 22:07:28.697805 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-03-19 22:07:28.700352 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-03-19 22:07:28.709873 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-03-19 22:07:28.700403836 +0000 UTC m=+21.928225913 LastTransitionTime:2026-03-19 22:07:28.700403756 +0000 UTC m=+21.928225843}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again 2026-03-19 22:07:28.717174 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-19 22:07:28.717201 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-19 22:07:28.717223 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc00163fa10] 2026-03-19 22:07:28.717326 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-03-19 22:07:29.679959 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-19 22:07:29.679985 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-19 22:07:30.085947 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-03-19 22:07:30.089144 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-03-19 22:07:30.284006 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-03-19 22:07:30.284044 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-03-19 22:07:30.286927 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-03-19 22:07:30.484252 I | ceph-csi: successfully removed CSI CephFS driver 2026-03-19 22:07:30.484291 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-03-19 22:07:30.486856 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-03-19 22:07:30.684467 I | ceph-csi: successfully removed CSI NFS driver 2026-03-19 22:07:46.594307 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-03-19 22:07:46.594344 I | ceph-cluster-controller: validating ceph version from provided image 2026-03-19 22:07:46.604000 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-19 22:07:46.604056 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-19 22:07:46.608098 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-03-19 22:07:46.608220 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-03-19 22:07:47.373223 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-03-19 22:07:47.871485 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7" 2026-03-19 22:07:48.229616 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-03-19 22:07:48.232201 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-03-19 22:07:48.257683 I | ceph-cluster-controller: external cluster identity established 2026-03-19 22:07:48.257712 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-03-19 22:07:48.923731 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-03-19 22:07:49.813196 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-03-19 22:07:49.813239 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-03-19 22:07:49.824868 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:07:50.118382 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-03-19 22:07:50.930669 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:07:51.240416 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-03-19 22:07:52.006617 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:07:52.207185 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-03-19 22:07:52.218263 I | ceph-cluster-controller: successfully updated csi config map 2026-03-19 22:07:52.218315 I | cephclient: getting or creating ceph auth key "client.crash" 2026-03-19 22:07:52.746895 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-03-19 22:07:52.776214 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-03-19 22:07:52.776306 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-03-19 22:07:52.776323 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-03-19 22:07:58.810212 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-19 22:07:58.810233 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-19 22:07:58.810244 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-03-19 22:08:00.636742 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-03-19 22:08:02.005170 I | ceph-object-controller: reconciling object store deployments 2026-03-19 22:08:02.022333 I | ceph-object-controller: ceph object store gateway service running at 10.110.23.142 2026-03-19 22:08:02.022425 I | ceph-object-controller: reconciling object store pools 2026-03-19 22:08:04.678449 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-03-19 22:08:04.678554 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-03-19 22:08:08.738674 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-03-19 22:08:08.738711 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-03-19 22:08:13.019825 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-03-19 22:08:13.019860 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-03-19 22:08:17.094916 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-03-19 22:08:17.094943 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-03-19 22:08:20.644667 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:25} {StateName:unknown Count:8}]" 2026-03-19 22:08:20.649051 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:08:21.783865 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:25} {StateName:unknown Count:8}]" 2026-03-19 22:08:21.788413 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:08:22.181291 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-03-19 22:08:22.181334 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-03-19 22:08:26.241753 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-03-19 22:08:26.241799 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-03-19 22:08:30.283378 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-03-19 22:08:30.283404 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-03-19 22:08:34.465781 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-03-19 22:08:34.465809 I | ceph-object-controller: configuring object store "ceph" 2026-03-19 22:08:35.086503 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-03-19 22:08:35.279041 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-03-19 22:08:35.688894 I | ceph-object-controller: configuration for object-store ceph is complete 2026-03-19 22:08:35.692975 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-03-19 22:08:35.697804 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-03-19 22:08:36.215398 I | ceph-object-controller: setting rgw config flags 2026-03-19 22:08:36.215427 I | ceph-object-controller: Configuring authentication with keystone 2026-03-19 22:08:36.215446 I | op-config: setting option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:36.620816 I | op-config: successfully set option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:36.620849 I | op-config: setting option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.025110 I | op-config: successfully set option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.025143 I | op-config: setting option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.436992 I | op-config: successfully set option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.437051 I | op-config: setting option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.911833 I | op-config: successfully set option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:37.911866 I | op-config: setting option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:38.820222 I | op-config: successfully set option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:38.820269 I | op-config: setting option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:39.723638 I | op-config: successfully set option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:39.723675 I | op-config: setting option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:39.919391 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:08:40.271080 I | op-config: successfully set option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:40.271106 I | op-config: setting option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:40.665993 I | op-config: successfully set option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:40.666044 I | op-config: setting option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.085137 I | op-config: successfully set option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.085174 I | op-config: setting option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.491079 I | op-config: successfully set option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.491113 I | op-config: setting option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.927315 I | op-config: successfully set option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:41.927349 I | op-config: setting option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:42.332773 I | op-config: successfully set option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:42.332817 I | op-config: setting option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:42.735754 I | op-config: successfully set option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:42.735794 I | op-config: setting option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.127827 I | op-config: successfully set option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.127853 I | op-config: setting option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.524914 I | op-config: successfully set option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.524946 I | op-config: setting option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.917966 I | op-config: successfully set option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:43.918000 I | op-config: setting option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:44.310580 I | op-config: successfully set option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database 2026-03-19 22:08:44.310925 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-03-19 22:08:44.361391 I | ceph-object-controller: enabling rgw dashboard 2026-03-19 22:08:46.405990 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-03-19 22:08:46.406552 I | ceph-object-controller: setting the dashboard api secret key 2026-03-19 22:08:47.306807 I | ceph-object-controller: done setting the dashboard api secret key 2026-03-19 22:08:47.394118 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:08:51.118307 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:08:52.277392 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:09:21.597574 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:09:22.740370 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:09:25.900342 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:09:52.098254 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:09:53.221043 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:10:11.850160 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:10:22.581546 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:10:23.723399 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:10:53.103352 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:10:54.229753 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:10:57.789993 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:11:23.630999 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:11:24.713078 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:11:43.748551 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:11:54.109846 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:11:55.184697 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:12:24.595832 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:12:25.653018 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:12:29.744145 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:12:55.064150 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:12:56.138142 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:13:15.680692 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:13:25.537723 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:13:26.624996 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:13:56.013342 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:13:57.097088 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:14:01.666772 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:14:26.497824 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:14:27.603943 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:14:47.647523 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:14:56.971258 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:14:58.082202 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:15:27.435990 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:15:28.575975 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:15:33.593807 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:15:58.010606 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:15:59.098367 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:16:19.622310 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:16:28.522965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:16:29.583827 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:16:59.054161 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:17:00.061489 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:17:05.610532 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:17:29.561458 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:17:30.554635 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:17:51.595684 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-19 22:18:00.050617 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:18:01.024855 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:18:30.543398 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:18:31.479944 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-19 22:18:37.547486 W | op-mon: external cluster mon count is 1, consider adding new monitors.