debug 2026-03-24T15:05:36.639+0000 7fa13d484a80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-03-24T15:05:36.639+0000 7fa13d484a80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-03-24T15:05:36.639+0000 7fa13d484a80 0 framework: beast debug 2026-03-24T15:05:36.639+0000 7fa13d484a80 0 framework conf key: port, val: 8080 debug 2026-03-24T15:05:36.639+0000 7fa13d484a80 1 init_numa not setting numa affinity debug 2026-03-24T15:05:37.115+0000 7fa13d484a80 0 framework: beast debug 2026-03-24T15:05:37.115+0000 7fa13d484a80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-03-24T15:05:37.115+0000 7fa13d484a80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-03-24T15:05:37.127+0000 7fa13d484a80 0 starting handler: beast debug 2026-03-24T15:05:37.139+0000 7fa13d484a80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-03-24T15:05:37.159+0000 7fa13d484a80 1 mgrc service_daemon_register rgw.14512 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-jv887,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026,kernel_version=5.15.0-173-generic,mem_swap_kb=0,mem_total_kb=65841448,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-jv887,pod_namespace=openstack,realm_id=0dd56b76-6a9e-4814-8972-90ee2f5668ec,realm_name=ceph,zone_id=b65cc824-9963-4e36-8dcf-5154ad9d5386,zone_name=ceph,zonegroup_id=94da0198-72a3-40f0-b711-bd0bc800083d,zonegroup_name=ceph} debug 2026-03-24T15:05:55.688+0000 7fa10a30e700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:05:55.692+0000 7fa10830a700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=0.004000074s ====== debug 2026-03-24T15:05:55.692+0000 7fa10830a700 1 beast: 0x7fa00890a730: 10.0.0.147 - - [24/Mar/2026:15:05:55.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000074s debug 2026-03-24T15:06:05.688+0000 7fa105b05700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:06:05.688+0000 7fa105b05700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:05.688+0000 7fa105b05700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:06:05.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:06:07.112+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:06:15.688+0000 7fa0fbaf1700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:06:15.688+0000 7fa0fbaf1700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:15.688+0000 7fa0fbaf1700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:06:15.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:06:25.688+0000 7fa0f7ae9700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:06:25.688+0000 7fa0f7ae9700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:25.688+0000 7fa0f7ae9700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:06:25.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:06:35.688+0000 7fa0f0adb700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:06:35.688+0000 7fa0f0adb700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:35.688+0000 7fa0f0adb700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:06:35.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:06:37.112+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:06:45.688+0000 7fa0e8acb700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:06:45.688+0000 7fa0e8acb700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:45.688+0000 7fa0e8acb700 1 beast: 0x7fa00890a730: 10.0.0.147 - - [24/Mar/2026:15:06:45.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:06:55.689+0000 7fa0e0abb700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:06:55.689+0000 7fa0e0abb700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:06:55.689+0000 7fa0e0abb700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:06:55.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:05.689+0000 7fa0daaaf700 1 ====== starting new request req=0x7fa008889730 ===== debug 2026-03-24T15:07:05.689+0000 7fa0daaaf700 1 ====== req done req=0x7fa008889730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:05.689+0000 7fa0daaaf700 1 beast: 0x7fa008889730: 10.0.0.147 - - [24/Mar/2026:15:07:05.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:07.113+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:07:10.029+0000 7fa0d3aa1700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:07:10.029+0000 7fa0d3aa1700 0 req 13378253050449605267 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:07:11.441+0000 7fa0d129c700 1 ====== req done req=0x7fa00890a730 op status=-2042 http_status=404 latency=1.412025809s ====== debug 2026-03-24T15:07:11.441+0000 7fa0d129c700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:07:10.029 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.412025809s debug 2026-03-24T15:07:11.441+0000 7fa0d32a0700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:07:11.441+0000 7fa0d32a0700 0 req 188477245594484832 0.000000000s :create_user No stored secret string, cache miss debug 2026-03-24T15:07:11.489+0000 7fa0ca28e700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=0.048000880s ====== debug 2026-03-24T15:07:11.489+0000 7fa0ca28e700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:07:11.441 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94&format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.048000880s debug 2026-03-24T15:07:11.537+0000 7fa0ce296700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:07:11.541+0000 7fa0ce296700 0 req 4491796116902685908 0.004000074s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:07:11.565+0000 7fa0c4282700 1 req 4491796116902685908 0.028000511s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-03-24T15:07:11.565+0000 7fa0c4282700 1 ====== req done req=0x7fa008088730 op status=0 http_status=404 latency=0.028000511s ====== debug 2026-03-24T15:07:11.565+0000 7fa0c4282700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:07:11.537 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000511s debug 2026-03-24T15:07:11.565+0000 7fa0c6a87700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:07:11.565+0000 7fa0c6a87700 0 req 8644094043937329058 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:07:11.645+0000 7fa0bd274700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.080001466s ====== debug 2026-03-24T15:07:11.645+0000 7fa0bd274700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:07:11.565 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.080001466s debug 2026-03-24T15:07:11.645+0000 7fa0c1a7d700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:07:11.645+0000 7fa0c1a7d700 0 req 7207594148319877980 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:07:11.689+0000 7fa0b6a67700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.044000808s ====== debug 2026-03-24T15:07:11.689+0000 7fa0b6a67700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:07:11.645 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000808s debug 2026-03-24T15:07:11.689+0000 7fa0bba71700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:07:11.689+0000 7fa0bba71700 0 req 4116394193378803419 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:07:11.721+0000 7fa0b0a5b700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.032000583s ====== debug 2026-03-24T15:07:11.721+0000 7fa0b0a5b700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:07:11.689 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000583s debug 2026-03-24T15:07:11.769+0000 7fa0b3260700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:07:11.769+0000 7fa0b3260700 0 req 4965769361353023269 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:07:11.809+0000 7fa0aaa4f700 1 ====== req done req=0x7fa008088730 op status=0 http_status=204 latency=0.040000733s ====== debug 2026-03-24T15:07:11.809+0000 7fa0aaa4f700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:07:11.769 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:07:15.689+0000 7fa0a5a45700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:07:15.689+0000 7fa0a5a45700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:15.689+0000 7fa0a5a45700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:07:15.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:25.689+0000 7fa09ea37700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:07:25.689+0000 7fa09ea37700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:25.689+0000 7fa09ea37700 1 beast: 0x7fa008007730: 10.0.0.147 - - [24/Mar/2026:15:07:25.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:35.689+0000 7fa096a27700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:07:35.689+0000 7fa096a27700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:35.689+0000 7fa096a27700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:07:35.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:37.113+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:07:37.113+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-03-24T15:07:45.690+0000 7fa08da15700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:07:45.690+0000 7fa08da15700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:45.690+0000 7fa08da15700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:07:45.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:07:55.690+0000 7fa084a03700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:07:55.690+0000 7fa084a03700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:07:55.690+0000 7fa084a03700 1 beast: 0x7fa008007730: 10.0.0.147 - - [24/Mar/2026:15:07:55.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:05.690+0000 7fa07d1f4700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:05.690+0000 7fa07d1f4700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:05.690+0000 7fa07d1f4700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:05.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:07.126+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:08:11.830+0000 7fa07e1f6700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:08:11.830+0000 7fa07e1f6700 0 req 7643209295878993827 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:08:12.858+0000 7fa07e1f6700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.028018832s ====== debug 2026-03-24T15:08:12.858+0000 7fa07e1f6700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:08:11.830 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028018832s debug 2026-03-24T15:08:12.862+0000 7fa0739e1700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:08:12.866+0000 7fa0739e1700 0 req 6796044073376097566 0.004000073s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:08:12.894+0000 7fa0711dc700 1 ====== req done req=0x7fa008007730 op status=-2 http_status=204 latency=0.032000586s ====== debug 2026-03-24T15:08:12.894+0000 7fa0711dc700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:08:12.862 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000586s debug 2026-03-24T15:08:12.894+0000 7fa06f1d8700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:08:12.894+0000 7fa06f1d8700 0 req 13248778448524923221 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:08:12.934+0000 7fa06d1d4700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.040000733s ====== debug 2026-03-24T15:08:12.934+0000 7fa06d1d4700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:08:12.894 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:08:12.934+0000 7fa06f9d9700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:08:12.934+0000 7fa06f9d9700 0 req 18209273039807435009 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:08:12.970+0000 7fa0689cb700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.036000662s ====== debug 2026-03-24T15:08:12.970+0000 7fa0689cb700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:08:12.934 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000662s debug 2026-03-24T15:08:12.974+0000 7fa06b9d1700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:08:12.974+0000 7fa06b9d1700 0 req 13448351919155750319 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:08:12.998+0000 7fa0651c4700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.024000440s ====== debug 2026-03-24T15:08:12.998+0000 7fa0651c4700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:08:12.974 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000440s debug 2026-03-24T15:08:13.042+0000 7fa0671c8700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:08:13.042+0000 7fa0671c8700 0 req 17936535785676239134 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:08:13.086+0000 7fa05d1b4700 1 ====== req done req=0x7fa008007730 op status=0 http_status=204 latency=0.044000808s ====== debug 2026-03-24T15:08:13.086+0000 7fa05d1b4700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:08:13.042 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000808s debug 2026-03-24T15:08:15.734+0000 7fa05b9b1700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:15.734+0000 7fa05b9b1700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:15.734+0000 7fa05b9b1700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:15.734 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:25.686+0000 7fa05299f700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:25.686+0000 7fa05299f700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:25.686+0000 7fa05299f700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:25.686 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:35.686+0000 7fa04b190700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:35.686+0000 7fa04b190700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:35.686+0000 7fa04b190700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:35.686 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:37.123+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:08:45.687+0000 7fa045985700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:45.687+0000 7fa045985700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:45.687+0000 7fa045985700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:45.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:08:55.687+0000 7fa04217e700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:08:55.687+0000 7fa04217e700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:08:55.687+0000 7fa04217e700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:08:55.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:05.687+0000 7fa03b971700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:09:05.687+0000 7fa03b971700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:05.687+0000 7fa03b971700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:09:05.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:07.139+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:09:13.099+0000 7fa03b170700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:09:13.099+0000 7fa03b170700 0 req 6348765565238472618 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:09:14.147+0000 7fa03b170700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.048019171s ====== debug 2026-03-24T15:09:14.147+0000 7fa03b170700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:09:13.099 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.048019171s debug 2026-03-24T15:09:14.151+0000 7fa02e156700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:09:14.151+0000 7fa02e156700 0 req 16818491212616676231 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:09:14.191+0000 7fa02c152700 1 ====== req done req=0x7fa008088730 op status=-2 http_status=204 latency=0.040000733s ====== debug 2026-03-24T15:09:14.191+0000 7fa02c152700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:09:14.151 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:09:14.191+0000 7fa02d955700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:09:14.195+0000 7fa02d955700 0 req 7427528450854438709 0.004000074s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:09:14.255+0000 7fa02814a700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.064001173s ====== debug 2026-03-24T15:09:14.255+0000 7fa02814a700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:09:14.191 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.064001173s debug 2026-03-24T15:09:14.255+0000 7fa02a94f700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:09:14.255+0000 7fa02a94f700 0 req 1766620337556752973 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:09:14.327+0000 7fa023941700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.072001323s ====== debug 2026-03-24T15:09:14.327+0000 7fa023941700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:09:14.255 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.072001323s debug 2026-03-24T15:09:14.327+0000 7fa026947700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:09:14.327+0000 7fa026947700 0 req 16704112757187360429 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:09:14.359+0000 7fa02013a700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.032000586s ====== debug 2026-03-24T15:09:14.359+0000 7fa02013a700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:09:14.327 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000586s debug 2026-03-24T15:09:14.403+0000 7fa02213e700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:09:14.403+0000 7fa02213e700 0 req 5556566063513583587 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:09:14.475+0000 7fa017929700 1 ====== req done req=0x7fa008088730 op status=0 http_status=204 latency=0.072001323s ====== debug 2026-03-24T15:09:14.475+0000 7fa017929700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:09:14.403 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.072001323s debug 2026-03-24T15:09:15.687+0000 7fa015925700 1 ====== starting new request req=0x7fa007f05730 ===== debug 2026-03-24T15:09:15.687+0000 7fa015925700 1 ====== req done req=0x7fa007f05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:15.687+0000 7fa015925700 1 beast: 0x7fa007f05730: 10.0.0.147 - - [24/Mar/2026:15:09:15.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:25.687+0000 7fa00e116700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:09:25.687+0000 7fa00e116700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:25.687+0000 7fa00e116700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:09:25.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:35.688+0000 7fa104b03700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:09:35.688+0000 7fa104b03700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:35.688+0000 7fa104b03700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:09:35.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:37.140+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:09:45.688+0000 7fa0f92ec700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:09:45.688+0000 7fa0f92ec700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:45.688+0000 7fa0f92ec700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:09:45.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:09:55.688+0000 7fa0f6ae7700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:09:55.688+0000 7fa0f6ae7700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:09:55.688+0000 7fa0f6ae7700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:09:55.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:05.688+0000 7fa0f52e4700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:05.688+0000 7fa0f52e4700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:05.688+0000 7fa0f52e4700 1 beast: 0x7fa008007730: 10.0.0.147 - - [24/Mar/2026:15:10:05.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:07.152+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:10:14.500+0000 7fa0f02da700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:10:14.500+0000 7fa0f02da700 0 req 10385685828505456825 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:10:15.532+0000 7fa0f02da700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.032018900s ====== debug 2026-03-24T15:10:15.532+0000 7fa0f02da700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:10:14.500 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032018900s debug 2026-03-24T15:10:15.536+0000 7fa0e9acd700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:15.536+0000 7fa0e9acd700 0 req 4879225204761852935 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:10:15.560+0000 7fa0e32c0700 1 ====== req done req=0x7fa008007730 op status=-2 http_status=204 latency=0.024000440s ====== debug 2026-03-24T15:10:15.560+0000 7fa0e32c0700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:10:15.536 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000440s debug 2026-03-24T15:10:15.560+0000 7fa0e4ac3700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:15.560+0000 7fa0e4ac3700 0 req 3189571702207913976 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:10:15.600+0000 7fa0ddab5700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.040000733s ====== debug 2026-03-24T15:10:15.600+0000 7fa0ddab5700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:10:15.560 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:10:15.600+0000 7fa0e8acb700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:15.600+0000 7fa0e8acb700 0 req 15604681167560217268 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:10:15.640+0000 7fa0da2ae700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.040000733s ====== debug 2026-03-24T15:10:15.640+0000 7fa0da2ae700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:10:15.600 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:10:15.640+0000 7fa0dc2b2700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:15.640+0000 7fa0dc2b2700 0 req 10921515959477847331 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:10:15.672+0000 7fa0dfab9700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.032000583s ====== debug 2026-03-24T15:10:15.672+0000 7fa0dfab9700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:10:15.640 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000583s debug 2026-03-24T15:10:15.688+0000 7fa0d2a9f700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:10:15.688+0000 7fa0d2a9f700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:15.688+0000 7fa0d2a9f700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:10:15.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:15.716+0000 7fa0cfa99700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:10:15.716+0000 7fa0cfa99700 0 req 12504245526140368699 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:10:15.756+0000 7fa0c8a8b700 1 ====== req done req=0x7fa008007730 op status=0 http_status=204 latency=0.040000733s ====== debug 2026-03-24T15:10:15.756+0000 7fa0c8a8b700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:10:15.716 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:10:25.688+0000 7fa0ce296700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:10:25.688+0000 7fa0ce296700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:25.688+0000 7fa0ce296700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:10:25.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:35.689+0000 7fa0be276700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:10:35.689+0000 7fa0be276700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:35.689+0000 7fa0be276700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:10:35.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:37.153+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:10:45.689+0000 7fa0b4262700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:10:45.689+0000 7fa0b4262700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:45.689+0000 7fa0b4262700 1 beast: 0x7fa008088730: 10.0.0.147 - - [24/Mar/2026:15:10:45.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:10:55.689+0000 7fa0aba51700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:10:55.689+0000 7fa0aba51700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:10:55.689+0000 7fa0aba51700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:10:55.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:05.689+0000 7fa0a7248700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:05.689+0000 7fa0a7248700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:05.689+0000 7fa0a7248700 1 beast: 0x7fa008088730: 10.0.0.147 - - [24/Mar/2026:15:11:05.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:07.161+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:11:15.689+0000 7fa09c232700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:11:15.689+0000 7fa09c232700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:15.689+0000 7fa09c232700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:11:15.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:15.773+0000 7fa098a2b700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:11:15.773+0000 7fa098a2b700 0 req 7682806917146751446 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:11:16.805+0000 7fa098a2b700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.032018900s ====== debug 2026-03-24T15:11:16.805+0000 7fa098a2b700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:11:15.773 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032018900s debug 2026-03-24T15:11:16.813+0000 7fa095a25700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:16.813+0000 7fa095a25700 0 req 2693479067797803597 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:11:16.837+0000 7fa091a1d700 1 ====== req done req=0x7fa008088730 op status=-2 http_status=204 latency=0.024000440s ====== debug 2026-03-24T15:11:16.837+0000 7fa091a1d700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:11:16.813 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000440s debug 2026-03-24T15:11:16.841+0000 7fa096226700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:16.841+0000 7fa096226700 0 req 15512759023436762461 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:11:16.873+0000 7fa08fa19700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.032000586s ====== debug 2026-03-24T15:11:16.873+0000 7fa08fa19700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:11:16.837 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000586s debug 2026-03-24T15:11:16.873+0000 7fa090a1b700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:16.877+0000 7fa090a1b700 0 req 7859672050113537569 0.004000073s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:11:16.917+0000 7fa089a0d700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.044000804s ====== debug 2026-03-24T15:11:16.917+0000 7fa089a0d700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:11:16.873 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000804s debug 2026-03-24T15:11:16.917+0000 7fa08ca13700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:16.917+0000 7fa08ca13700 0 req 13371494175028448251 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:11:16.945+0000 7fa086206700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.028000511s ====== debug 2026-03-24T15:11:16.945+0000 7fa086206700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:11:16.917 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000511s debug 2026-03-24T15:11:16.989+0000 7fa08820a700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:11:16.989+0000 7fa08820a700 0 req 15803249178478882542 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:11:17.029+0000 7fa07e9f7700 1 ====== req done req=0x7fa008088730 op status=0 http_status=204 latency=0.040000733s ====== debug 2026-03-24T15:11:17.029+0000 7fa07e9f7700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:11:16.989 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:11:25.690+0000 7fa0769e7700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:11:25.690+0000 7fa0769e7700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:25.690+0000 7fa0769e7700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:11:25.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:35.690+0000 7fa0721de700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:11:35.690+0000 7fa0721de700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:35.690+0000 7fa0721de700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:11:35.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:37.162+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:11:45.690+0000 7fa06d1d4700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:11:45.690+0000 7fa06d1d4700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:45.690+0000 7fa06d1d4700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:11:45.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:11:55.690+0000 7fa0609bb700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:11:55.690+0000 7fa0609bb700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:11:55.690+0000 7fa0609bb700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:11:55.690 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:05.686+0000 7fa05e1b6700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:05.686+0000 7fa05e1b6700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:05.686+0000 7fa05e1b6700 1 beast: 0x7fa008007730: 10.0.0.147 - - [24/Mar/2026:15:12:05.686 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:07.162+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:12:15.687+0000 7fa0569a7700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:12:15.687+0000 7fa0569a7700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:15.687+0000 7fa0569a7700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:12:15.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:17.043+0000 7fa0559a5700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:12:17.043+0000 7fa0559a5700 0 req 12765950582961228503 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:12:18.079+0000 7fa0559a5700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.036018968s ====== debug 2026-03-24T15:12:18.079+0000 7fa0559a5700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:12:17.043 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.036018968s debug 2026-03-24T15:12:18.083+0000 7fa04a98f700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:18.083+0000 7fa04a98f700 0 req 5773097825527684031 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:12:18.115+0000 7fa04898b700 1 ====== req done req=0x7fa008007730 op status=-2 http_status=204 latency=0.032000583s ====== debug 2026-03-24T15:12:18.115+0000 7fa04898b700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:12:18.083 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000583s debug 2026-03-24T15:12:18.115+0000 7fa047989700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:18.115+0000 7fa047989700 0 req 1533594410547316967 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:12:18.151+0000 7fa044182700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.036000662s ====== debug 2026-03-24T15:12:18.151+0000 7fa044182700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:12:18.115 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000662s debug 2026-03-24T15:12:18.151+0000 7fa05299f700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:18.151+0000 7fa05299f700 0 req 13755981595291889675 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:12:18.191+0000 7fa03f178700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.040000729s ====== debug 2026-03-24T15:12:18.191+0000 7fa03f178700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:12:18.151 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000729s debug 2026-03-24T15:12:18.195+0000 7fa043180700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:18.195+0000 7fa043180700 0 req 12782779667832246651 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:12:18.219+0000 7fa03a96f700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.024000440s ====== debug 2026-03-24T15:12:18.219+0000 7fa03a96f700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:12:18.195 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000440s debug 2026-03-24T15:12:18.263+0000 7fa03d174700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:12:18.263+0000 7fa03d174700 0 req 8180593087594202085 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:12:18.311+0000 7fa034963700 1 ====== req done req=0x7fa008007730 op status=0 http_status=204 latency=0.048000876s ====== debug 2026-03-24T15:12:18.311+0000 7fa034963700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:12:18.263 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.048000876s debug 2026-03-24T15:12:25.687+0000 7fa02d154700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:12:25.687+0000 7fa02d154700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:25.687+0000 7fa02d154700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:12:25.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:35.687+0000 7fa02a14e700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:12:35.687+0000 7fa02a14e700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:35.687+0000 7fa02a14e700 1 beast: 0x7fa008088730: 10.0.0.147 - - [24/Mar/2026:15:12:35.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:37.163+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:12:45.687+0000 7fa02a94f700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:12:45.687+0000 7fa02a94f700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:45.687+0000 7fa02a94f700 1 beast: 0x7fa008088730: 10.0.0.147 - - [24/Mar/2026:15:12:45.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:12:55.687+0000 7fa01e136700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:12:55.687+0000 7fa01e136700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:12:55.687+0000 7fa01e136700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:12:55.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:05.687+0000 7fa01a12e700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:13:05.687+0000 7fa01a12e700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:05.687+0000 7fa01a12e700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:13:05.687 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:07.171+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:13:15.688+0000 7fa01011a700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:13:15.688+0000 7fa01011a700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:15.688+0000 7fa01011a700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:13:15.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:18.332+0000 7fa00f919700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:13:18.332+0000 7fa00f919700 0 req 16650342975116712023 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:13:19.372+0000 7fa00f919700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.040019035s ====== debug 2026-03-24T15:13:19.372+0000 7fa00f919700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:13:18.332 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040019035s debug 2026-03-24T15:13:19.384+0000 7fa1002fa700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:13:19.384+0000 7fa1002fa700 0 req 15573007187304366129 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:13:19.408+0000 7fa10d314700 1 ====== req done req=0x7fa008088730 op status=-2 http_status=204 latency=0.024000438s ====== debug 2026-03-24T15:13:19.408+0000 7fa10d314700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:13:19.384 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000438s debug 2026-03-24T15:13:19.412+0000 7fa1022fe700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:13:19.412+0000 7fa1022fe700 0 req 17129473710342788016 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:13:19.444+0000 7fa103b01700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.032000583s ====== debug 2026-03-24T15:13:19.444+0000 7fa103b01700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:13:19.412 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000583s debug 2026-03-24T15:13:19.444+0000 7fa0feaf7700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:13:19.448+0000 7fa0feaf7700 0 req 11929517448875362469 0.004000073s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:13:19.500+0000 7fa0f92ec700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.056001022s ====== debug 2026-03-24T15:13:19.500+0000 7fa0f92ec700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:13:19.444 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.056001022s debug 2026-03-24T15:13:19.500+0000 7fa0f8aeb700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:13:19.500+0000 7fa0f8aeb700 0 req 5047700811525906981 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:13:19.532+0000 7fa0f6ae7700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.032000583s ====== debug 2026-03-24T15:13:19.532+0000 7fa0f6ae7700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:13:19.500 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000583s debug 2026-03-24T15:13:19.576+0000 7fa0fe2f6700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:13:19.576+0000 7fa0fe2f6700 0 req 15648413547545425023 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:13:19.620+0000 7fa0ef2d8700 1 ====== req done req=0x7fa008088730 op status=0 http_status=204 latency=0.044000804s ====== debug 2026-03-24T15:13:19.620+0000 7fa0ef2d8700 1 beast: 0x7fa008088730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:13:19.576 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000804s debug 2026-03-24T15:13:25.688+0000 7fa0e52c4700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:13:25.688+0000 7fa0e52c4700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:25.688+0000 7fa0e52c4700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:13:25.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:35.688+0000 7fa0e5ac5700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:13:35.688+0000 7fa0e5ac5700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:35.688+0000 7fa0e5ac5700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:13:35.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:37.172+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:13:45.688+0000 7fa0d82aa700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:13:45.688+0000 7fa0d82aa700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:45.688+0000 7fa0d82aa700 1 beast: 0x7fa008007730: 10.0.0.147 - - [24/Mar/2026:15:13:45.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:13:55.688+0000 7fa0dfab9700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:13:55.688+0000 7fa0dfab9700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:13:55.688+0000 7fa0dfab9700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:13:55.688 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:05.689+0000 7fa0c828a700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:14:05.689+0000 7fa0c828a700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:05.689+0000 7fa0c828a700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:14:05.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:07.181+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:14:15.689+0000 7fa0c0a7b700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:14:15.689+0000 7fa0c227e700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:15.689+0000 7fa0c227e700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:14:15.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:19.685+0000 7fa0c0a7b700 1 ====== starting new request req=0x7fa00890a730 ===== debug 2026-03-24T15:14:19.685+0000 7fa0c0a7b700 0 req 11975722987019916663 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-24T15:14:20.713+0000 7fa0c0a7b700 1 ====== req done req=0x7fa00890a730 op status=0 http_status=200 latency=1.028018713s ====== debug 2026-03-24T15:14:20.713+0000 7fa0c0a7b700 1 beast: 0x7fa00890a730: 10.0.0.146 - rgw-admin-ops-user [24/Mar/2026:15:14:19.685 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028018713s debug 2026-03-24T15:14:20.717+0000 7fa0c1a7d700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:14:20.717+0000 7fa0c1a7d700 0 req 8230376294921175520 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:14:20.745+0000 7fa0b826a700 1 ====== req done req=0x7fa008007730 op status=-2 http_status=204 latency=0.028000511s ====== debug 2026-03-24T15:14:20.745+0000 7fa0b826a700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:14:20.717 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000511s debug 2026-03-24T15:14:20.745+0000 7fa0b6a67700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:14:20.745+0000 7fa0b6a67700 0 req 10297393647347952262 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-24T15:14:20.781+0000 7fa0bba71700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.036000658s ====== debug 2026-03-24T15:14:20.781+0000 7fa0bba71700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:14:20.745 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000658s debug 2026-03-24T15:14:20.781+0000 7fa0b6266700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:14:20.781+0000 7fa0b6266700 0 req 14963792400262515343 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-24T15:14:20.821+0000 7fa0aca53700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.040000733s ====== debug 2026-03-24T15:14:20.821+0000 7fa0aca53700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:14:20.781 +0000] "PUT /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:14:20.821+0000 7fa0ab250700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:14:20.821+0000 7fa0ab250700 0 req 1520637597560862412 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-24T15:14:20.849+0000 7fa0aa24e700 1 ====== req done req=0x7fa008007730 op status=0 http_status=200 latency=0.028000511s ====== debug 2026-03-24T15:14:20.849+0000 7fa0aa24e700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:14:20.821 +0000] "GET /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000511s debug 2026-03-24T15:14:20.893+0000 7fa0b025a700 1 ====== starting new request req=0x7fa008007730 ===== debug 2026-03-24T15:14:20.893+0000 7fa0b025a700 0 req 8819455557216836429 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-24T15:14:20.933+0000 7fa09d234700 1 ====== req done req=0x7fa008007730 op status=0 http_status=204 latency=0.040000733s ====== debug 2026-03-24T15:14:20.933+0000 7fa09d234700 1 beast: 0x7fa008007730: 10.0.0.146 - rook-ceph-internal-s3-user-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94 [24/Mar/2026:15:14:20.893 +0000] "DELETE /rook-ceph-bucket-checker-6fa65539-e326-4c1f-a6f1-d38efdc9ea94/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000733s debug 2026-03-24T15:14:25.689+0000 7fa09fa39700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:14:25.689+0000 7fa09fa39700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:25.689+0000 7fa09fa39700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:14:25.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:35.693+0000 7fa095224700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:14:35.693+0000 7fa095224700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:35.693+0000 7fa095224700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:14:35.693 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:37.181+0000 7fa13c014700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-24T15:14:45.689+0000 7fa08c212700 1 ====== starting new request req=0x7fa008088730 ===== debug 2026-03-24T15:14:45.689+0000 7fa08c212700 1 ====== req done req=0x7fa008088730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:45.689+0000 7fa08c212700 1 beast: 0x7fa008088730: 10.0.0.147 - - [24/Mar/2026:15:14:45.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-24T15:14:55.689+0000 7fa085204700 1 ====== starting new request req=0x7fa007f86730 ===== debug 2026-03-24T15:14:55.689+0000 7fa085204700 1 ====== req done req=0x7fa007f86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-24T15:14:55.689+0000 7fa085204700 1 beast: 0x7fa007f86730: 10.0.0.147 - - [24/Mar/2026:15:14:55.689 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s