debug 2026-03-19T18:07:10.426+0000 7fbde744fa80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-03-19T18:07:10.430+0000 7fbde744fa80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-03-19T18:07:10.430+0000 7fbde744fa80 0 framework: beast debug 2026-03-19T18:07:10.430+0000 7fbde744fa80 0 framework conf key: port, val: 8080 debug 2026-03-19T18:07:10.430+0000 7fbde744fa80 1 init_numa not setting numa affinity debug 2026-03-19T18:07:10.910+0000 7fbde744fa80 0 framework: beast debug 2026-03-19T18:07:10.910+0000 7fbde744fa80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-03-19T18:07:10.910+0000 7fbde744fa80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-03-19T18:07:10.926+0000 7fbde744fa80 0 starting handler: beast debug 2026-03-19T18:07:10.930+0000 7fbde744fa80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-03-19T18:07:10.950+0000 7fbde744fa80 1 mgrc service_daemon_register rgw.14510 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-qj98w,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026,kernel_version=5.15.0-173-generic,mem_swap_kb=0,mem_total_kb=65841448,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-qj98w,pod_namespace=openstack,realm_id=9c9592dc-95b9-46d4-8592-16e6eab1d996,realm_name=ceph,zone_id=5e521073-58c0-4160-a8f4-2793957bfa61,zone_name=ceph,zonegroup_id=dfe75da6-6e9d-4b07-8bdd-0cf131285335,zonegroup_name=ceph} debug 2026-03-19T18:07:29.426+0000 7fbdb72df700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:07:29.430+0000 7fbdb1ad4700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.004000003s ====== debug 2026-03-19T18:07:29.430+0000 7fbdb1ad4700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:07:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000003s debug 2026-03-19T18:07:39.426+0000 7fbdae2cd700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:07:39.426+0000 7fbdae2cd700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:07:39.426+0000 7fbdae2cd700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:07:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:07:40.910+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:07:49.426+0000 7fbda62bd700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:07:49.426+0000 7fbda62bd700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:07:49.426+0000 7fbda62bd700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:07:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:07:59.426+0000 7fbda6abe700 1 ====== starting new request req=0x7fbcb2854730 ===== debug 2026-03-19T18:07:59.426+0000 7fbda6abe700 1 ====== req done req=0x7fbcb2854730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:07:59.426+0000 7fbda6abe700 1 beast: 0x7fbcb2854730: 10.0.0.18 - - [19/Mar/2026:18:07:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:09.426+0000 7fbd9c2a9700 1 ====== starting new request req=0x7fbcb2854730 ===== debug 2026-03-19T18:08:09.426+0000 7fbd9c2a9700 1 ====== req done req=0x7fbcb2854730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:09.426+0000 7fbd9c2a9700 1 beast: 0x7fbcb2854730: 10.0.0.18 - - [19/Mar/2026:18:08:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:10.910+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:08:19.426+0000 7fbd9a2a5700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:08:19.426+0000 7fbd9a2a5700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:19.426+0000 7fbd9a2a5700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:08:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:29.426+0000 7fbd8b287700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:08:29.426+0000 7fbd8b287700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:29.426+0000 7fbd8b287700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:08:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:39.426+0000 7fbd84279700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:08:39.426+0000 7fbd84279700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:39.426+0000 7fbd84279700 1 beast: 0x7fbcb28d5730: 10.0.0.18 - - [19/Mar/2026:18:08:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:40.910+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:08:43.678+0000 7fbd7aa66700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:08:43.678+0000 7fbd7aa66700 0 req 2846571286995899931 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:08:45.066+0000 7fbd78261700 1 ====== req done req=0x7fbcb28d5730 op status=-2042 http_status=404 latency=1.388000727s ====== debug 2026-03-19T18:08:45.066+0000 7fbd78261700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:08:43.678 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.388000727s debug 2026-03-19T18:08:45.070+0000 7fbd78261700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:08:45.070+0000 7fbd78261700 0 req 760147129741718839 0.000000000s :create_user No stored secret string, cache miss debug 2026-03-19T18:08:45.114+0000 7fbd70a52700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=0.044000026s ====== debug 2026-03-19T18:08:45.114+0000 7fbd70a52700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:08:45.070 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7&format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.044000026s debug 2026-03-19T18:08:45.162+0000 7fbd7a265700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:08:45.162+0000 7fbd7a265700 0 req 5345494164634038694 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:08:45.194+0000 7fbd6a245700 1 req 5345494164634038694 0.032000020s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-03-19T18:08:45.194+0000 7fbd6a245700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=404 latency=0.032000020s ====== debug 2026-03-19T18:08:45.194+0000 7fbd6a245700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:08:45.162 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:08:45.194+0000 7fbd6a245700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:08:45.194+0000 7fbd6a245700 0 req 2516635459228057893 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:08:45.250+0000 7fbd62a36700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.056000032s ====== debug 2026-03-19T18:08:45.250+0000 7fbd62a36700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:08:45.194 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.056000032s debug 2026-03-19T18:08:45.254+0000 7fbd6da4c700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:08:45.254+0000 7fbd6da4c700 0 req 16384479620825936750 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:08:45.290+0000 7fbd5c229700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.036000021s ====== debug 2026-03-19T18:08:45.290+0000 7fbd5c229700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:08:45.254 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000021s debug 2026-03-19T18:08:45.290+0000 7fbd61233700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:08:45.290+0000 7fbd61233700 0 req 14275331975292001962 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:08:45.322+0000 7fbd5621d700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.032000020s ====== debug 2026-03-19T18:08:45.322+0000 7fbd5621d700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:08:45.290 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:08:45.370+0000 7fbd5aa26700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:08:45.370+0000 7fbd5aa26700 0 req 16371485089141525703 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:08:45.406+0000 7fbd51213700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=204 latency=0.036000025s ====== debug 2026-03-19T18:08:45.406+0000 7fbd51213700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:08:45.370 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:08:49.426+0000 7fbd4f20f700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:08:49.426+0000 7fbd4f20f700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:49.426+0000 7fbd4f20f700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:08:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:08:59.426+0000 7fbd48a02700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:08:59.426+0000 7fbd48a02700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:08:59.426+0000 7fbd48a02700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:08:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:09.426+0000 7fbd449fa700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:09:09.426+0000 7fbd449fa700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:09.426+0000 7fbd449fa700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:09:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:10.910+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:09:10.910+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-03-19T18:09:19.426+0000 7fbd3b9e8700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:19.426+0000 7fbd3b9e8700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:19.426+0000 7fbd3b9e8700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:09:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:29.426+0000 7fbd341d9700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:09:29.426+0000 7fbd341d9700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:29.426+0000 7fbd341d9700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:09:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:39.426+0000 7fbd281c1700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:09:39.426+0000 7fbd281c1700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:39.426+0000 7fbd281c1700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:09:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:40.918+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:09:45.426+0000 7fbd231b7700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:09:45.426+0000 7fbd231b7700 0 req 5680855495529171477 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:09:46.470+0000 7fbd231b7700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.044000626s ====== debug 2026-03-19T18:09:46.470+0000 7fbd231b7700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:09:45.426 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044000626s debug 2026-03-19T18:09:46.474+0000 7fbd239b8700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:46.474+0000 7fbd239b8700 0 req 6677966496876243108 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:09:46.518+0000 7fbd1c9aa700 1 ====== req done req=0x7fbcb1fd2730 op status=-2 http_status=204 latency=0.044000026s ====== debug 2026-03-19T18:09:46.518+0000 7fbd1c9aa700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:09:46.470 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000026s debug 2026-03-19T18:09:46.518+0000 7fbd1f9b0700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:46.518+0000 7fbd1f9b0700 0 req 7014508205690435471 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:09:46.550+0000 7fbd189a2700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.032000020s ====== debug 2026-03-19T18:09:46.550+0000 7fbd189a2700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:09:46.518 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:09:46.550+0000 7fbd1b1a7700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:46.550+0000 7fbd1b1a7700 0 req 5381754501477618145 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:09:46.586+0000 7fbd14199700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:09:46.586+0000 7fbd14199700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:09:46.550 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:09:46.590+0000 7fbd1719f700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:46.590+0000 7fbd1719f700 0 req 2265642783212554329 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:09:46.610+0000 7fbd10992700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.020000013s ====== debug 2026-03-19T18:09:46.610+0000 7fbd10992700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:09:46.590 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000013s debug 2026-03-19T18:09:46.654+0000 7fbd12996700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:09:46.654+0000 7fbd12996700 0 req 15288557427046794248 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:09:46.690+0000 7fbd08181700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=204 latency=0.036000021s ====== debug 2026-03-19T18:09:46.690+0000 7fbd08181700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:09:46.654 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000021s debug 2026-03-19T18:09:49.450+0000 7fbd0617d700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:09:49.450+0000 7fbd0617d700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:49.450+0000 7fbd0617d700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:09:49.450 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:09:59.426+0000 7fbcfd96c700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:09:59.426+0000 7fbcfd96c700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:09:59.426+0000 7fbcfd96c700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:09:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:09.426+0000 7fbcf595c700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:09.426+0000 7fbcf595c700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:09.426+0000 7fbcf595c700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:10:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:10.918+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:10:19.426+0000 7fbcee94e700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:19.426+0000 7fbcee94e700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:19.426+0000 7fbcee94e700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:10:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:29.426+0000 7fbce8942700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:10:29.426+0000 7fbce8942700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:29.426+0000 7fbce8942700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:10:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:39.426+0000 7fbcdf930700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:39.426+0000 7fbcdf930700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:39.426+0000 7fbcdf930700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:10:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:40.926+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:10:46.706+0000 7fbcdb127700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:10:46.706+0000 7fbcdb127700 0 req 13270909276072108918 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:10:47.734+0000 7fbcdb127700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.028000593s ====== debug 2026-03-19T18:10:47.734+0000 7fbcdb127700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:10:46.706 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028000593s debug 2026-03-19T18:10:47.738+0000 7fbcd511b700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:47.738+0000 7fbcd511b700 0 req 11455487246270510190 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:10:47.762+0000 7fbcd2916700 1 ====== req done req=0x7fbcb2053730 op status=-2 http_status=204 latency=0.024000013s ====== debug 2026-03-19T18:10:47.762+0000 7fbcd2916700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:10:47.738 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000013s debug 2026-03-19T18:10:47.762+0000 7fbcd491a700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:47.762+0000 7fbcd491a700 0 req 4836567350250859131 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:10:47.798+0000 7fbccd90c700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.036000021s ====== debug 2026-03-19T18:10:47.798+0000 7fbccd90c700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:10:47.762 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000021s debug 2026-03-19T18:10:47.798+0000 7fbcd0111700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:47.798+0000 7fbcd0111700 0 req 13402240130143471840 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:10:47.838+0000 7fbcc8101700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.040000025s ====== debug 2026-03-19T18:10:47.838+0000 7fbcc8101700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:10:47.798 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000025s debug 2026-03-19T18:10:47.842+0000 7fbcca906700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:47.842+0000 7fbcca906700 0 req 1891935993466382744 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:10:47.866+0000 7fbcc28f6700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.024000013s ====== debug 2026-03-19T18:10:47.866+0000 7fbcc28f6700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:10:47.842 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000013s debug 2026-03-19T18:10:47.910+0000 7fbcc68fe700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:10:47.910+0000 7fbcc68fe700 0 req 13255265141148631593 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:10:47.946+0000 7fbcbd0eb700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=204 latency=0.036000021s ====== debug 2026-03-19T18:10:47.946+0000 7fbcbd0eb700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:10:47.910 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000021s debug 2026-03-19T18:10:49.426+0000 7fbcbb0e7700 1 ====== starting new request req=0x7fbcb1ed0730 ===== debug 2026-03-19T18:10:49.426+0000 7fbcbb0e7700 1 ====== req done req=0x7fbcb1ed0730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:49.426+0000 7fbcbb0e7700 1 beast: 0x7fbcb1ed0730: 10.0.0.18 - - [19/Mar/2026:18:10:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:10:59.426+0000 7fbdb02d1700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:10:59.426+0000 7fbdb02d1700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:10:59.426+0000 7fbdb02d1700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:10:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:09.426+0000 7fbda9ac4700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:09.426+0000 7fbda9ac4700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:09.426+0000 7fbda9ac4700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:11:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:10.926+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:11:19.426+0000 7fbda62bd700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:19.426+0000 7fbda62bd700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:19.426+0000 7fbda62bd700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:11:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:29.426+0000 7fbd9daac700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:29.426+0000 7fbd9daac700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:29.426+0000 7fbd9daac700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:11:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:39.426+0000 7fbd9629d700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:11:39.426+0000 7fbd9629d700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:39.426+0000 7fbd9629d700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:11:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:40.930+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:11:47.962+0000 7fbd9c2a9700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:11:47.962+0000 7fbd9c2a9700 0 req 2805070845034121325 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:11:49.006+0000 7fbd9c2a9700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.044000626s ====== debug 2026-03-19T18:11:49.006+0000 7fbd9c2a9700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:11:47.962 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044000626s debug 2026-03-19T18:11:49.010+0000 7fbd88a82700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:49.010+0000 7fbd88a82700 0 req 3667483095266694351 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:11:49.050+0000 7fbd88281700 1 ====== req done req=0x7fbcb1fd2730 op status=-2 http_status=204 latency=0.040000025s ====== debug 2026-03-19T18:11:49.050+0000 7fbd88281700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:11:49.010 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000025s debug 2026-03-19T18:11:49.050+0000 7fbd8e28d700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:49.050+0000 7fbd8e28d700 0 req 2866231144686700796 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:11:49.086+0000 7fbd83a78700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:11:49.086+0000 7fbd83a78700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:11:49.050 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:11:49.086+0000 7fbd84a7a700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:49.086+0000 7fbd84a7a700 0 req 182870837029016561 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:11:49.138+0000 7fbd80271700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.052000031s ====== debug 2026-03-19T18:11:49.138+0000 7fbd80271700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:11:49.086 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052000031s debug 2026-03-19T18:11:49.142+0000 7fbd80271700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:49.142+0000 7fbd80271700 0 req 12466739757146506939 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:11:49.174+0000 7fbd7ba68700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.032000020s ====== debug 2026-03-19T18:11:49.174+0000 7fbd7ba68700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:11:49.142 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:11:49.218+0000 7fbd83277700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:11:49.218+0000 7fbd83277700 0 req 10779843625846900770 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:11:49.306+0000 7fbd73a58700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=204 latency=0.088000059s ====== debug 2026-03-19T18:11:49.306+0000 7fbd73a58700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:11:49.218 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.088000059s debug 2026-03-19T18:11:49.426+0000 7fbd7625d700 1 ====== starting new request req=0x7fbcb1ed0730 ===== debug 2026-03-19T18:11:49.426+0000 7fbd7625d700 1 ====== req done req=0x7fbcb1ed0730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:49.426+0000 7fbd7625d700 1 beast: 0x7fbcb1ed0730: 10.0.0.18 - - [19/Mar/2026:18:11:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:11:59.426+0000 7fbd6a245700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:11:59.426+0000 7fbd6a245700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:11:59.426+0000 7fbd6a245700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:11:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:09.426+0000 7fbd6da4c700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:09.426+0000 7fbd6da4c700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:09.426+0000 7fbd6da4c700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:12:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:10.934+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:12:19.426+0000 7fbd5e22d700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:12:19.426+0000 7fbd5e22d700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:19.426+0000 7fbd5e22d700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:12:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:29.426+0000 7fbd52a16700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:29.426+0000 7fbd52a16700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:29.426+0000 7fbd52a16700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:12:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:39.426+0000 7fbd4ea0e700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:12:39.426+0000 7fbd4ea0e700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:39.426+0000 7fbd4ea0e700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:12:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:40.938+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:12:49.322+0000 7fbd4d20b700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:12:49.322+0000 7fbd4d20b700 0 req 1117342520801436343 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:12:49.426+0000 7fbd409f2700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:12:49.426+0000 7fbd409f2700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:49.426+0000 7fbd409f2700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:12:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:12:50.354+0000 7fbd3c9ea700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.032000661s ====== debug 2026-03-19T18:12:50.354+0000 7fbd3c9ea700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:12:49.322 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032000661s debug 2026-03-19T18:12:50.358+0000 7fbd3f9f0700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:50.358+0000 7fbd3f9f0700 0 req 16771476386778858116 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:12:50.382+0000 7fbd391e3700 1 ====== req done req=0x7fbcb2053730 op status=-2 http_status=204 latency=0.024000015s ====== debug 2026-03-19T18:12:50.382+0000 7fbd391e3700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:12:50.358 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000015s debug 2026-03-19T18:12:50.382+0000 7fbd449fa700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:50.382+0000 7fbd449fa700 0 req 12317998629419011408 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:12:50.414+0000 7fbd349da700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.032000020s ====== debug 2026-03-19T18:12:50.414+0000 7fbd349da700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:12:50.382 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:12:50.414+0000 7fbd379e0700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:50.414+0000 7fbd379e0700 0 req 101192471932036158 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:12:50.450+0000 7fbd319d4700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:12:50.450+0000 7fbd319d4700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:12:50.414 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:12:50.450+0000 7fbd2e9ce700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:50.450+0000 7fbd2e9ce700 0 req 16597599633837634445 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:12:50.486+0000 7fbd2d1cb700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:12:50.486+0000 7fbd2d1cb700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:12:50.450 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:12:50.526+0000 7fbd2e1cd700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:12:50.526+0000 7fbd2e1cd700 0 req 6881712116354907525 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:12:50.562+0000 7fbd259bc700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=204 latency=0.036000025s ====== debug 2026-03-19T18:12:50.562+0000 7fbd259bc700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:12:50.526 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:12:59.426+0000 7fbd229b6700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:12:59.426+0000 7fbd229b6700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:12:59.426+0000 7fbd229b6700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:12:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:09.426+0000 7fbd239b8700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:13:09.426+0000 7fbd239b8700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:09.426+0000 7fbd239b8700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:13:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:10.938+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:13:19.426+0000 7fbd1a9a6700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:19.426+0000 7fbd1a9a6700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:19.426+0000 7fbd1a9a6700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:13:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:29.426+0000 7fbd0e18d700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:29.426+0000 7fbd0e18d700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:29.426+0000 7fbd0e18d700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:13:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:39.426+0000 7fbd0517b700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:13:39.426+0000 7fbd0517b700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:39.426+0000 7fbd0517b700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:13:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:40.942+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:13:49.426+0000 7fbcff970700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:13:49.426+0000 7fbcff970700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:49.426+0000 7fbcff970700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:13:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:13:50.578+0000 7fbd00171700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:13:50.578+0000 7fbd00171700 0 req 6037469044963620002 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:13:51.610+0000 7fbcfd96c700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.032000661s ====== debug 2026-03-19T18:13:51.610+0000 7fbcfd96c700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:13:50.578 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032000661s debug 2026-03-19T18:13:51.610+0000 7fbcff16f700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:51.610+0000 7fbcff16f700 0 req 12224204842013129074 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:13:51.642+0000 7fbcf2956700 1 ====== req done req=0x7fbcb1fd2730 op status=-2 http_status=204 latency=0.032000020s ====== debug 2026-03-19T18:13:51.642+0000 7fbcf2956700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:13:51.610 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:13:51.642+0000 7fbcf715f700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:51.642+0000 7fbcf715f700 0 req 2272484436186172683 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:13:51.678+0000 7fbced14b700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:13:51.678+0000 7fbced14b700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:13:51.642 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:13:51.682+0000 7fbcf7960700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:51.682+0000 7fbcf7960700 0 req 6271372163630643789 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:13:51.722+0000 7fbce7940700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.040000025s ====== debug 2026-03-19T18:13:51.722+0000 7fbce7940700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:13:51.682 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000025s debug 2026-03-19T18:13:51.722+0000 7fbcec94a700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:51.722+0000 7fbcec94a700 0 req 2989135698757574469 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:13:51.750+0000 7fbce3938700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.028000018s ====== debug 2026-03-19T18:13:51.750+0000 7fbce3938700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:13:51.722 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000018s debug 2026-03-19T18:13:51.794+0000 7fbce613d700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:13:51.794+0000 7fbce613d700 0 req 4955219331581913829 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:13:51.834+0000 7fbce1133700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=204 latency=0.040000025s ====== debug 2026-03-19T18:13:51.834+0000 7fbce1133700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:13:51.794 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000025s debug 2026-03-19T18:13:59.426+0000 7fbcdf930700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:13:59.426+0000 7fbcdf930700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:13:59.426+0000 7fbcdf930700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:13:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:09.426+0000 7fbcd2115700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:14:09.426+0000 7fbcd2115700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:09.426+0000 7fbcd2115700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:14:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:10.942+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:14:19.426+0000 7fbccb908700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:19.426+0000 7fbccb908700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:19.426+0000 7fbccb908700 1 beast: 0x7fbcb2053730: 10.0.0.18 - - [19/Mar/2026:18:14:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:29.426+0000 7fbcc40f9700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:14:29.426+0000 7fbcc40f9700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:29.426+0000 7fbcc40f9700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:14:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:39.426+0000 7fbcbc0e9700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:14:39.426+0000 7fbcbc0e9700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:39.426+0000 7fbcbc0e9700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:14:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:40.954+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:14:49.426+0000 7fbdb6ade700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:14:49.426+0000 7fbdb6ade700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:49.426+0000 7fbdb6ade700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:14:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:14:51.850+0000 7fbdadacc700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:14:51.850+0000 7fbdadacc700 0 req 3026296469656161326 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:14:52.914+0000 7fbdadacc700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.064000726s ====== debug 2026-03-19T18:14:52.914+0000 7fbdadacc700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:14:51.850 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.064000726s debug 2026-03-19T18:14:52.922+0000 7fbdacaca700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:52.922+0000 7fbdacaca700 0 req 7842183358330846406 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:14:52.950+0000 7fbda52bb700 1 ====== req done req=0x7fbcb2053730 op status=-2 http_status=204 latency=0.028000018s ====== debug 2026-03-19T18:14:52.950+0000 7fbda52bb700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:14:52.922 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000018s debug 2026-03-19T18:14:52.950+0000 7fbdaa2c5700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:52.950+0000 7fbdaa2c5700 0 req 15497859953057984833 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:14:52.994+0000 7fbda2ab6700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.044000030s ====== debug 2026-03-19T18:14:52.994+0000 7fbda2ab6700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:14:52.950 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000030s debug 2026-03-19T18:14:52.994+0000 7fbd9f2af700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:52.994+0000 7fbd9f2af700 0 req 1468312859955136730 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:14:53.030+0000 7fbd9b2a7700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:14:53.030+0000 7fbd9b2a7700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:14:52.994 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:14:53.034+0000 7fbda82c1700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:53.034+0000 7fbda82c1700 0 req 3114828346224244743 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:14:53.054+0000 7fbd97aa0700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=200 latency=0.020000013s ====== debug 2026-03-19T18:14:53.054+0000 7fbd97aa0700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:14:53.034 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000013s debug 2026-03-19T18:14:53.098+0000 7fbd9caaa700 1 ====== starting new request req=0x7fbcb2053730 ===== debug 2026-03-19T18:14:53.098+0000 7fbd9caaa700 0 req 5455244273399268675 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:14:53.138+0000 7fbd91293700 1 ====== req done req=0x7fbcb2053730 op status=0 http_status=204 latency=0.040000025s ====== debug 2026-03-19T18:14:53.138+0000 7fbd91293700 1 beast: 0x7fbcb2053730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:14:53.098 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000025s debug 2026-03-19T18:14:59.426+0000 7fbd8f28f700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:14:59.426+0000 7fbd8f28f700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:14:59.426+0000 7fbd8f28f700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:14:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:09.426+0000 7fbd8b287700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:15:09.426+0000 7fbd8b287700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:09.426+0000 7fbd8b287700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:15:09.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:10.954+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:15:19.426+0000 7fbd7ba68700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:15:19.426+0000 7fbd7ba68700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:19.426+0000 7fbd7ba68700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:15:19.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:29.426+0000 7fbd6aa46700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:29.426+0000 7fbd6aa46700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:29.426+0000 7fbd6aa46700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:15:29.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:39.426+0000 7fbd6ea4e700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:39.426+0000 7fbd6ea4e700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:39.426+0000 7fbd6ea4e700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:15:39.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:40.962+0000 7fbde5fdf700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-19T18:15:49.426+0000 7fbd64239700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:49.426+0000 7fbd64239700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:49.426+0000 7fbd64239700 1 beast: 0x7fbcb1fd2730: 10.0.0.18 - - [19/Mar/2026:18:15:49.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-19T18:15:53.150+0000 7fbd64a3a700 1 ====== starting new request req=0x7fbcb28d5730 ===== debug 2026-03-19T18:15:53.150+0000 7fbd64a3a700 0 req 17732886140140319740 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-19T18:15:54.178+0000 7fbd5c229700 1 ====== req done req=0x7fbcb28d5730 op status=0 http_status=200 latency=1.028000593s ====== debug 2026-03-19T18:15:54.178+0000 7fbd5c229700 1 beast: 0x7fbcb28d5730: 10.0.0.172 - rgw-admin-ops-user [19/Mar/2026:18:15:53.150 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028000593s debug 2026-03-19T18:15:54.182+0000 7fbd59a24700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:54.182+0000 7fbd59a24700 0 req 16755511144702628707 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:15:54.214+0000 7fbd57a20700 1 ====== req done req=0x7fbcb1fd2730 op status=-2 http_status=204 latency=0.032000020s ====== debug 2026-03-19T18:15:54.214+0000 7fbd57a20700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:15:54.182 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:15:54.214+0000 7fbd59223700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:54.214+0000 7fbd59223700 0 req 15878546368386912728 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-19T18:15:54.246+0000 7fbd53217700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.032000020s ====== debug 2026-03-19T18:15:54.246+0000 7fbd53217700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:15:54.214 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:15:54.250+0000 7fbd58221700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:54.250+0000 7fbd58221700 0 req 9655455647836355014 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-19T18:15:54.286+0000 7fbd4ca0a700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.036000025s ====== debug 2026-03-19T18:15:54.286+0000 7fbd4ca0a700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:15:54.250 +0000] "PUT /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000025s debug 2026-03-19T18:15:54.286+0000 7fbd58a22700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:54.286+0000 7fbd58a22700 0 req 6619091605860888839 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-19T18:15:54.314+0000 7fbd4fa10700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=200 latency=0.028000018s ====== debug 2026-03-19T18:15:54.314+0000 7fbd4fa10700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:15:54.286 +0000] "GET /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000018s debug 2026-03-19T18:15:54.362+0000 7fbd52a16700 1 ====== starting new request req=0x7fbcb1fd2730 ===== debug 2026-03-19T18:15:54.362+0000 7fbd52a16700 0 req 17895352976211496464 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-19T18:15:54.394+0000 7fbd431f7700 1 ====== req done req=0x7fbcb1fd2730 op status=0 http_status=204 latency=0.032000020s ====== debug 2026-03-19T18:15:54.394+0000 7fbd431f7700 1 beast: 0x7fbcb1fd2730: 10.0.0.172 - rook-ceph-internal-s3-user-checker-c56c975a-d2fd-4e87-a224-db030ea368a7 [19/Mar/2026:18:15:54.362 +0000] "DELETE /rook-ceph-bucket-checker-c56c975a-d2fd-4e87-a224-db030ea368a7/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000020s debug 2026-03-19T18:15:59.426+0000 7fbd3e9ee700 1 ====== starting new request req=0x7fbcb1f51730 ===== debug 2026-03-19T18:15:59.426+0000 7fbd3e9ee700 1 ====== req done req=0x7fbcb1f51730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-19T18:15:59.426+0000 7fbd3e9ee700 1 beast: 0x7fbcb1f51730: 10.0.0.18 - - [19/Mar/2026:18:15:59.426 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s