2026/03/29 02:09:14 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota
2026-03-29 02:09:14.851004 I | rookcmd: starting Rook v1.15.9 with arguments '/usr/local/bin/rook ceph operator'
2026-03-29 02:09:14.851030 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO
2026-03-29 02:09:14.851032 I | cephcmd: starting Rook-Ceph operator
2026-03-29 02:09:14.945861 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.4 (e7ad5345525c7aa95470c26863873b581076945d) reef (stable)"
2026-03-29 02:09:14.954814 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_CEPHFS" = "false"
2026-03-29 02:09:14.954841 I | op-k8sutil: operator setting "CSI_CEPHFS_FSGROUPPOLICY" = "File"
2026-03-29 02:09:14.954852 I | op-k8sutil: operator setting "CSI_PROVISIONER_PRIORITY_CLASSNAME" = "system-cluster-critical"
2026-03-29 02:09:14.954868 I | op-k8sutil: operator setting "CSI_NFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-03-29 02:09:14.954881 I | op-k8sutil: operator setting "CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT" = "false"
2026-03-29 02:09:14.954916 I | op-k8sutil: operator setting "CSI_RBD_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n    limits:\n      memory: 1Gi\n- name : csi-omap-generator\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-03-29 02:09:14.954934 I | op-k8sutil: operator setting "ROOK_CSI_ATTACHER_IMAGE" = "registry.k8s.io/sig-storage/csi-attacher:v4.6.1"
2026-03-29 02:09:14.954944 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_NFS" = "false"
2026-03-29 02:09:14.954959 I | op-k8sutil: operator setting "ROOK_CSI_IMAGE_PULL_POLICY" = "IfNotPresent"
2026-03-29 02:09:14.954968 I | op-k8sutil: operator setting "CSI_ENABLE_NFS_SNAPSHOTTER" = "true"
2026-03-29 02:09:14.954975 I | op-k8sutil: operator setting "CSI_ENABLE_TOPOLOGY" = "false"
2026-03-29 02:09:14.954987 I | op-k8sutil: operator setting "ROOK_CSI_PROVISIONER_IMAGE" = "registry.k8s.io/sig-storage/csi-provisioner:v5.0.1"
2026-03-29 02:09:14.954993 I | op-k8sutil: operator setting "CSI_FORCE_CEPHFS_KERNEL_CLIENT" = "true"
2026-03-29 02:09:14.955015 I | op-k8sutil: operator setting "CSI_NFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-03-29 02:09:14.955032 I | op-k8sutil: operator setting "CSI_PROVISIONER_REPLICAS" = "2"
2026-03-29 02:09:14.955040 I | op-k8sutil: operator setting "CSI_RBD_FSGROUPPOLICY" = "File"
2026-03-29 02:09:14.955049 I | op-k8sutil: operator setting "ROOK_CEPH_ALLOW_LOOP_DEVICES" = "false"
2026-03-29 02:09:14.955064 I | op-k8sutil: operator setting "ROOK_CSI_REGISTRAR_IMAGE" = "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.11.1"
2026-03-29 02:09:14.955071 I | op-k8sutil: operator setting "CSI_DISABLE_HOLDER_PODS" = "true"
2026-03-29 02:09:14.955077 I | op-k8sutil: operator setting "CSI_ENABLE_CEPHFS_SNAPSHOTTER" = "true"
2026-03-29 02:09:14.955088 I | op-k8sutil: operator setting "ROOK_CSI_SNAPSHOTTER_IMAGE" = "registry.k8s.io/sig-storage/csi-snapshotter:v8.0.1"
2026-03-29 02:09:14.955096 I | op-k8sutil: operator setting "ROOK_CSIADDONS_IMAGE" = "quay.io/csiaddons/k8s-sidecar:v0.9.1"
2026-03-29 02:09:14.955102 I | op-k8sutil: operator setting "ROOK_CSI_DISABLE_DRIVER" = "false"
2026-03-29 02:09:14.955142 I | op-k8sutil: operator setting "CSI_NFS_ATTACH_REQUIRED" = "true"
2026-03-29 02:09:14.955167 I | op-k8sutil: operator setting "CSI_RBD_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-03-29 02:09:14.955184 I | op-k8sutil: operator setting "ROOK_CSI_CEPH_IMAGE" = "quay.io/cephcsi/cephcsi:v3.12.3"
2026-03-29 02:09:14.955193 I | op-k8sutil: operator setting "ROOK_LOG_LEVEL" = "INFO"
2026-03-29 02:09:14.955217 I | op-k8sutil: operator setting "CSI_CEPHFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-03-29 02:09:14.955246 I | op-k8sutil: operator setting "CSI_NFS_FSGROUPPOLICY" = "File"
2026-03-29 02:09:14.955263 I | op-k8sutil: operator setting "ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS" = "15"
2026-03-29 02:09:14.955270 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_RBD" = "false"
2026-03-29 02:09:14.955299 I | op-k8sutil: operator setting "CSI_CEPHFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-03-29 02:09:14.955319 I | op-k8sutil: operator setting "CSI_PLUGIN_PRIORITY_CLASSNAME" = "system-node-critical"
2026-03-29 02:09:14.955329 I | op-k8sutil: operator setting "CSI_ENABLE_ENCRYPTION" = "false"
2026-03-29 02:09:14.955338 I | op-k8sutil: operator setting "CSI_ENABLE_OMAP_GENERATOR" = "false"
2026-03-29 02:09:14.955352 I | op-k8sutil: operator setting "CSI_GRPC_TIMEOUT_SECONDS" = "150"
2026-03-29 02:09:14.955360 I | op-k8sutil: operator setting "CSI_RBD_ATTACH_REQUIRED" = "true"
2026-03-29 02:09:14.955369 I | op-k8sutil: operator setting "ROOK_CSI_RESIZER_IMAGE" = "registry.k8s.io/sig-storage/csi-resizer:v1.11.1"
2026-03-29 02:09:14.955377 I | op-k8sutil: operator setting "ROOK_ENABLE_DISCOVERY_DAEMON" = "false"
2026-03-29 02:09:14.955383 I | op-k8sutil: operator setting "CSI_CEPHFS_ATTACH_REQUIRED" = "true"
2026-03-29 02:09:14.955391 I | op-k8sutil: operator setting "CSI_ENABLE_CSIADDONS" = "false"
2026-03-29 02:09:14.955406 I | op-k8sutil: operator setting "ROOK_OBC_WATCH_OPERATOR_NAMESPACE" = "true"
2026-03-29 02:09:14.955414 I | op-k8sutil: operator setting "CSI_ENABLE_RBD_SNAPSHOTTER" = "true"
2026-03-29 02:09:14.955423 I | op-k8sutil: operator setting "CSI_ENABLE_VOLUME_GROUP_SNAPSHOT" = "true"
2026-03-29 02:09:14.955438 I | op-k8sutil: operator setting "CSI_ENABLE_HOST_NETWORK" = "true"
2026-03-29 02:09:14.955447 I | op-k8sutil: operator setting "CSI_ENABLE_METADATA" = "false"
2026-03-29 02:09:14.955456 I | operator: watching all namespaces for Ceph CRs
2026-03-29 02:09:14.955578 I | operator: setting up schemes
2026-03-29 02:09:14.959363 I | operator: setting up the controller-runtime manager
2026-03-29 02:09:14.959928 I | ceph-cluster-controller: successfully started
2026-03-29 02:09:14.960486 I | ceph-cluster-controller: enabling hotplug orchestration
2026-03-29 02:09:14.960519 I | ceph-nodedaemon-controller: successfully started
2026-03-29 02:09:14.960554 I | ceph-block-pool-controller: successfully started
2026-03-29 02:09:14.960582 I | ceph-object-store-user-controller: successfully started
2026-03-29 02:09:14.960611 I | ceph-object-realm-controller: successfully started
2026-03-29 02:09:14.960624 I | ceph-object-zonegroup-controller: successfully started
2026-03-29 02:09:14.960635 I | ceph-object-zone-controller: successfully started
2026-03-29 02:09:14.960791 I | ceph-object-controller: successfully started
2026-03-29 02:09:14.960863 I | ceph-file-controller: successfully started
2026-03-29 02:09:14.960901 I | ceph-nfs-controller: successfully started
2026-03-29 02:09:14.960953 I | ceph-rbd-mirror-controller: successfully started
2026-03-29 02:09:14.960991 I | ceph-client-controller: successfully started
2026-03-29 02:09:14.961023 I | ceph-filesystem-mirror-controller: successfully started
2026-03-29 02:09:14.961064 I | operator: rook-ceph-operator-config-controller successfully started
2026-03-29 02:09:14.961084 I | ceph-csi: rook-ceph-operator-csi-controller successfully started
2026-03-29 02:09:14.961349 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started
2026-03-29 02:09:14.961376 I | ceph-bucket-topic: successfully started
2026-03-29 02:09:14.961387 I | ceph-bucket-notification: successfully started
2026-03-29 02:09:14.961405 I | ceph-bucket-notification: successfully started
2026-03-29 02:09:14.961428 I | ceph-fs-subvolumegroup-controller: successfully started
2026-03-29 02:09:14.961505 I | blockpool-rados-namespace-controller: successfully started
2026-03-29 02:09:14.961593 I | ceph-cosi-controller: successfully started
2026-03-29 02:09:14.961630 I | operator: starting the controller-runtime manager
2026-03-29 02:09:15.377462 I | operator: rook-ceph-operator-config-controller done reconciling
2026-03-29 02:09:15.412872 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-03-29 02:09:15.416192 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-03-29 02:09:15.419123 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-03-29 02:09:15.426044 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-03-29 02:09:15.426068 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-03-29 02:09:15.428332 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-03-29 02:09:15.433860 I | ceph-csi: successfully removed CSI CephFS driver
2026-03-29 02:09:15.433882 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-03-29 02:09:15.435935 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-03-29 02:09:15.445912 I | ceph-csi: successfully removed CSI NFS driver
2026-03-29 02:09:37.201287 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph"
2026-03-29 02:09:37.204500 I | clusterdisruption-controller: deleted all legacy node drain canary pods
2026-03-29 02:09:37.209814 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph"
2026-03-29 02:09:37.219468 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-29 02:09:37.219512 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-29 02:09:37.219664 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket"
2026-03-29 02:09:37.220116 I | op-bucket-prov: successfully reconciled bucket provisioner
I0329 02:09:37.220212       1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket"
2026-03-29 02:09:37.223957 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack"
2026-03-29 02:09:37.246112 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-29 02:09:37.246140 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-29 02:09:37.246156 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc0018b90e0]
2026-03-29 02:09:37.246171 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-03-29 02:09:38.207357 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-29 02:09:38.207390 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-29 02:09:38.613173 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-03-29 02:09:38.616210 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-03-29 02:09:38.808519 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-03-29 02:09:38.808548 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-03-29 02:09:38.811467 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-03-29 02:09:39.010589 I | ceph-csi: successfully removed CSI CephFS driver
2026-03-29 02:09:39.010618 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-03-29 02:09:39.012898 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-03-29 02:09:39.215372 I | ceph-csi: successfully removed CSI NFS driver
2026-03-29 02:09:57.833774 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-03-29 02:09:57.833798 I | ceph-cluster-controller: validating ceph version from provided image
2026-03-29 02:09:57.839077 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-29 02:09:57.839095 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-29 02:09:57.841220 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config
2026-03-29 02:09:57.841294 I | cephclient: generated admin config in /var/lib/rook/openstack
2026-03-29 02:09:58.286714 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 <unknown version>", consider upgrading
2026-03-29 02:09:58.742857 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7"
2026-03-29 02:09:58.797953 I | ceph-cluster-controller: creating "rook-config-override" configmap
2026-03-29 02:09:58.800589 I | ceph-cluster-controller: creating "rook-ceph-config" secret
2026-03-29 02:09:59.201788 I | ceph-cluster-controller: external cluster identity established
2026-03-29 02:09:59.201821 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner"
2026-03-29 02:09:59.891584 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node"
2026-03-29 02:10:00.399311 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner"
2026-03-29 02:10:00.873750 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node"
2026-03-29 02:10:01.382138 I | ceph-csi: created kubernetes csi secrets for cluster "openstack"
2026-03-29 02:10:01.388954 I | ceph-cluster-controller: successfully updated csi config map
2026-03-29 02:10:01.388974 I | cephclient: getting or creating ceph auth key "client.crash"
2026-03-29 02:10:01.873753 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack"
2026-03-29 02:10:01.957681 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack"
2026-03-29 02:10:01.957752 I | ceph-cluster-controller: ceph status check interval is 1m0s
2026-03-29 02:10:01.957758 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack"
2026-03-29 02:10:07.278516 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-03-29 02:10:07.278555 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-03-29 02:10:07.278574 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-03-29 02:10:07.861614 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings
2026-03-29 02:10:07.861637 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd
2026-03-29 02:10:07.869603 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:10:08.333737 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:10:08.798421 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:10:09.548933 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-03-29 02:10:10.813019 I | ceph-object-controller: reconciling object store deployments
2026-03-29 02:10:10.829709 I | ceph-object-controller: ceph object store gateway service running at 10.111.2.254
2026-03-29 02:10:10.829754 I | ceph-object-controller: reconciling object store pools
2026-03-29 02:10:14.224848 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-03-29 02:10:14.224885 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-03-29 02:10:18.914395 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-03-29 02:10:18.914423 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-03-29 02:10:22.968186 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-03-29 02:10:22.968215 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-03-29 02:10:27.040416 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-03-29 02:10:27.040598 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-03-29 02:10:31.110194 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-03-29 02:10:31.110234 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-03-29 02:10:35.162256 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-03-29 02:10:35.162294 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-03-29 02:10:38.638672 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:46} {StateName:unknown Count:3}]"
2026-03-29 02:10:38.642673 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:10:39.619915 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:49} {StateName:unknown Count:8}]"
2026-03-29 02:10:39.623502 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:10:40.251460 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-03-29 02:10:40.251485 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-03-29 02:10:44.319751 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-03-29 02:10:44.319784 I | ceph-object-controller: configuring object store "ceph"
2026-03-29 02:10:44.923083 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph
2026-03-29 02:10:45.097453 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph"
2026-03-29 02:10:45.705350 I | ceph-object-controller: configuration for object-store ceph is complete
2026-03-29 02:10:45.708296 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-03-29 02:10:45.711574 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-03-29 02:10:46.228175 I | ceph-object-controller: setting rgw config flags
2026-03-29 02:10:46.228202 I | ceph-object-controller: Configuring authentication with keystone
2026-03-29 02:10:46.228224 I | op-config: setting option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:46.630658 I | op-config: successfully set option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:46.630705 I | op-config: setting option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:47.020988 I | op-config: successfully set option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:47.021024 I | op-config: setting option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:47.822286 I | op-config: successfully set option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:47.822312 I | op-config: setting option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:48.648088 I | op-config: successfully set option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:48.648158 I | op-config: setting option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:49.009392 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:10:49.235806 I | op-config: successfully set option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:49.235841 I | op-config: setting option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:49.631362 I | op-config: successfully set option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:49.631399 I | op-config: setting option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.017651 I | op-config: successfully set option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.017727 I | op-config: setting option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.406195 I | op-config: successfully set option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.406233 I | op-config: setting option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.805096 I | op-config: successfully set option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:50.805131 I | op-config: setting option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.211056 I | op-config: successfully set option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.211087 I | op-config: setting option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.588886 I | op-config: successfully set option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.588926 I | op-config: setting option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.973222 I | op-config: successfully set option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:51.973259 I | op-config: setting option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:52.383037 I | op-config: successfully set option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:52.383076 I | op-config: setting option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:52.771116 I | op-config: successfully set option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:52.771155 I | op-config: setting option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.140348 I | op-config: successfully set option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.140378 I | op-config: setting option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.522247 I | op-config: successfully set option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.522364 I | op-config: setting option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.919627 I | op-config: successfully set option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-03-29 02:10:53.920067 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-03-29 02:10:53.959828 I | ceph-object-controller: enabling rgw dashboard
2026-03-29 02:10:55.917095 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-03-29 02:10:55.917524 I | ceph-object-controller: setting the dashboard api secret key
2026-03-29 02:10:56.716292 I | ceph-object-controller: done setting the dashboard api secret key
2026-03-29 02:10:56.855423 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:11:09.129881 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:11:10.104997 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:11:34.951920 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:11:39.610975 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:11:40.599069 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:12:10.075240 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:1}]"
2026-03-29 02:12:10.081143 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:12:11.045544 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:1}]"
2026-03-29 02:12:11.048984 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:12:20.901936 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:12:40.531748 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:109} {StateName:peering Count:3}]"
2026-03-29 02:12:40.536032 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:12:41.503885 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:peering Count:3}]"
2026-03-29 02:12:41.507913 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:13:06.817802 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:13:11.000099 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:13:11.968341 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:13:41.468321 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:13:42.444161 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:13:52.768146 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:14:11.942560 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:121} {StateName:peering Count:1}]"
2026-03-29 02:14:11.946554 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:14:12.929354 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:121} {StateName:peering Count:1}]"
2026-03-29 02:14:12.933926 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:14:38.712657 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:14:42.411744 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:14:43.392596 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:15:12.893458 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:15:13.902554 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:15:24.689206 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:15:43.376488 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:15:44.389972 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:16:10.668359 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:16:13.865427 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:16:14.852916 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:16:44.329247 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:16:45.312525 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:16:56.590224 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:17:14.789309 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:17:15.777938 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:17:42.499221 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:17:45.243822 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:17:46.255192 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:18:15.734336 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:18:16.749430 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:18:28.483632 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:18:46.227338 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:18:47.231833 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:19:14.461305 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:19:16.711947 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:19:17.698746 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:19:47.186681 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:19:48.180965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:20:00.382134 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:20:17.676575 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:20:18.657149 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:20:46.332426 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-03-29 02:20:48.143358 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-03-29 02:20:49.123159 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0