debug 2026-03-25T21:27:20.461+0000 7fb5c660fa80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-03-25T21:27:20.461+0000 7fb5c660fa80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-03-25T21:27:20.461+0000 7fb5c660fa80 0 framework: beast debug 2026-03-25T21:27:20.461+0000 7fb5c660fa80 0 framework conf key: port, val: 8080 debug 2026-03-25T21:27:20.461+0000 7fb5c660fa80 1 init_numa not setting numa affinity debug 2026-03-25T21:27:20.941+0000 7fb5c660fa80 0 framework: beast debug 2026-03-25T21:27:20.941+0000 7fb5c660fa80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-03-25T21:27:20.941+0000 7fb5c660fa80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-03-25T21:27:20.953+0000 7fb5c660fa80 0 starting handler: beast debug 2026-03-25T21:27:20.957+0000 7fb5c660fa80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-03-25T21:27:20.973+0000 7fb5c660fa80 1 mgrc service_daemon_register rgw.14512 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-7fvqw,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026,kernel_version=5.15.0-173-generic,mem_swap_kb=0,mem_total_kb=65841448,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-7fvqw,pod_namespace=openstack,realm_id=252f669c-60b0-4481-9e9f-37416ea8bba5,realm_name=ceph,zone_id=8479d0b1-059f-4b96-a8e3-8f140db3f35a,zone_name=ceph,zonegroup_id=78f21547-d66d-4ef7-8cd1-e53e5ebc3a12,zonegroup_name=ceph} debug 2026-03-25T21:27:38.990+0000 7fb59449b700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:27:38.994+0000 7fb591495700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.004000109s ====== debug 2026-03-25T21:27:38.994+0000 7fb591495700 1 beast: 0x7fb491a95730: 10.0.0.187 - - [25/Mar/2026:21:27:38.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000109s debug 2026-03-25T21:27:48.990+0000 7fb593c9a700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:27:48.990+0000 7fb593c9a700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:27:48.990+0000 7fb593c9a700 1 beast: 0x7fb491a95730: 10.0.0.187 - - [25/Mar/2026:21:27:48.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:27:50.942+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:27:58.991+0000 7fb58e48f700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:27:58.991+0000 7fb58e48f700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:27:58.991+0000 7fb58e48f700 1 beast: 0x7fb491a95730: 10.0.0.187 - - [25/Mar/2026:21:27:58.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:28:08.991+0000 7fb581c76700 1 ====== starting new request req=0x7fb491a14730 ===== debug 2026-03-25T21:28:08.991+0000 7fb581c76700 1 ====== req done req=0x7fb491a14730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:28:08.991+0000 7fb581c76700 1 beast: 0x7fb491a14730: 10.0.0.187 - - [25/Mar/2026:21:28:08.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:28:18.991+0000 7fb57545d700 1 ====== starting new request req=0x7fb491a14730 ===== debug 2026-03-25T21:28:18.991+0000 7fb57545d700 1 ====== req done req=0x7fb491a14730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:28:18.991+0000 7fb57545d700 1 beast: 0x7fb491a14730: 10.0.0.187 - - [25/Mar/2026:21:28:18.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:28:20.943+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:28:28.991+0000 7fb577c62700 1 ====== starting new request req=0x7fb491a14730 ===== debug 2026-03-25T21:28:28.991+0000 7fb577c62700 1 ====== req done req=0x7fb491a14730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:28:28.991+0000 7fb577c62700 1 beast: 0x7fb491a14730: 10.0.0.187 - - [25/Mar/2026:21:28:28.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:28:38.988+0000 7fb56f451700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:28:38.992+0000 7fb56f451700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.004000109s ====== debug 2026-03-25T21:28:38.992+0000 7fb56f451700 1 beast: 0x7fb491a95730: 10.0.0.187 - - [25/Mar/2026:21:28:38.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000109s debug 2026-03-25T21:28:48.988+0000 7fb561435700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:28:48.992+0000 7fb561435700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.004000109s ====== debug 2026-03-25T21:28:48.992+0000 7fb561435700 1 beast: 0x7fb491a95730: 10.0.0.187 - - [25/Mar/2026:21:28:48.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000109s debug 2026-03-25T21:28:50.940+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:28:53.432+0000 7fb55ac28700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:28:53.436+0000 7fb55ac28700 0 req 10595391992259342349 0.004000109s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:28:54.820+0000 7fb558423700 1 ====== req done req=0x7fb491a95730 op status=-2042 http_status=404 latency=1.388037920s ====== debug 2026-03-25T21:28:54.820+0000 7fb558423700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:28:53.432 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.388037920s debug 2026-03-25T21:28:54.824+0000 7fb55a427700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:28:54.824+0000 7fb55a427700 0 req 7733300466083600021 0.000000000s :create_user No stored secret string, cache miss debug 2026-03-25T21:28:54.864+0000 7fb550c14700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=0.040001094s ====== debug 2026-03-25T21:28:54.864+0000 7fb550c14700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:28:54.820 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f&format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.040001094s debug 2026-03-25T21:28:54.912+0000 7fb55541d700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:28:54.912+0000 7fb55541d700 0 req 2531676893854366250 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:28:54.932+0000 7fb549c06700 1 req 2531676893854366250 0.020000545s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-03-25T21:28:54.932+0000 7fb549c06700 1 ====== req done req=0x7fb491213730 op status=0 http_status=404 latency=0.020000545s ====== debug 2026-03-25T21:28:54.932+0000 7fb549c06700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:28:54.912 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000545s debug 2026-03-25T21:28:54.932+0000 7fb54e40f700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:28:54.932+0000 7fb54e40f700 0 req 9683047480988354064 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:28:54.984+0000 7fb541bf6700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.052001424s ====== debug 2026-03-25T21:28:54.984+0000 7fb541bf6700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:28:54.932 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001424s debug 2026-03-25T21:28:54.984+0000 7fb547401700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:28:54.984+0000 7fb547401700 0 req 14609093244402012216 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:28:55.020+0000 7fb53a3e7700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.036000986s ====== debug 2026-03-25T21:28:55.020+0000 7fb53a3e7700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:28:54.984 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000986s debug 2026-03-25T21:28:55.024+0000 7fb5383e3700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:28:55.024+0000 7fb5383e3700 0 req 7514709324149953531 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:28:55.044+0000 7fb5363df700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.020000547s ====== debug 2026-03-25T21:28:55.044+0000 7fb5363df700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:28:55.024 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000547s debug 2026-03-25T21:28:55.088+0000 7fb538be4700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:28:55.088+0000 7fb538be4700 0 req 5087418954814087866 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:28:55.116+0000 7fb52fbd2700 1 ====== req done req=0x7fb491213730 op status=0 http_status=204 latency=0.028000765s ====== debug 2026-03-25T21:28:55.120+0000 7fb52fbd2700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:28:55.088 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000765s debug 2026-03-25T21:28:58.988+0000 7fb52a3c7700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:28:58.988+0000 7fb52a3c7700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:28:58.988+0000 7fb52a3c7700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:28:58.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:08.988+0000 7fb5243bb700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:08.988+0000 7fb5243bb700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:08.988+0000 7fb5243bb700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:29:08.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:18.989+0000 7fb51bbaa700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:29:18.989+0000 7fb51bbaa700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:18.989+0000 7fb51bbaa700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:29:18.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:20.941+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:29:20.941+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-03-25T21:29:29.029+0000 7fb5173a1700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:29.029+0000 7fb5173a1700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:29.029+0000 7fb5173a1700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:29:29.029 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:38.989+0000 7fb50bb8a700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:29:38.989+0000 7fb50bb8a700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:38.989+0000 7fb50bb8a700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:29:38.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:48.990+0000 7fb50537d700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:48.990+0000 7fb50537d700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:48.990+0000 7fb50537d700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:29:48.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:29:50.946+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:29:55.134+0000 7fb503b7a700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:29:55.134+0000 7fb503b7a700 0 req 1165200433842148146 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:29:56.174+0000 7fb503b7a700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.040028453s ====== debug 2026-03-25T21:29:56.174+0000 7fb503b7a700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:29:55.134 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040028453s debug 2026-03-25T21:29:56.178+0000 7fb4f9b66700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:56.178+0000 7fb4f9b66700 0 req 4899450222294403875 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:29:56.210+0000 7fb4f6b60700 1 ====== req done req=0x7fb491192730 op status=-2 http_status=204 latency=0.032000877s ====== debug 2026-03-25T21:29:56.210+0000 7fb4f6b60700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:29:56.178 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000877s debug 2026-03-25T21:29:56.214+0000 7fb4f9365700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:56.214+0000 7fb4f9365700 0 req 8892441334404639230 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:29:56.242+0000 7fb4f2357700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.028000765s ====== debug 2026-03-25T21:29:56.242+0000 7fb4f2357700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:29:56.214 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000765s debug 2026-03-25T21:29:56.242+0000 7fb4f535d700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:56.242+0000 7fb4f535d700 0 req 7698027277215802857 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:29:56.274+0000 7fb4edb4e700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.032000873s ====== debug 2026-03-25T21:29:56.274+0000 7fb4edb4e700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:29:56.242 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:29:56.274+0000 7fb4f0b54700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:56.274+0000 7fb4f0b54700 0 req 15010949377745336146 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:29:56.298+0000 7fb4ea347700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.024000656s ====== debug 2026-03-25T21:29:56.298+0000 7fb4ea347700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:29:56.274 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000656s debug 2026-03-25T21:29:56.342+0000 7fb4e9b46700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:29:56.342+0000 7fb4e9b46700 0 req 775746817848320423 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:29:56.374+0000 7fb4e1b36700 1 ====== req done req=0x7fb491192730 op status=0 http_status=204 latency=0.032000873s ====== debug 2026-03-25T21:29:56.374+0000 7fb4e1b36700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:29:56.342 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:29:58.990+0000 7fb4e0333700 1 ====== starting new request req=0x7fb491090730 ===== debug 2026-03-25T21:29:58.990+0000 7fb4e0333700 1 ====== req done req=0x7fb491090730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:29:58.990+0000 7fb4e0333700 1 beast: 0x7fb491090730: 10.0.0.187 - - [25/Mar/2026:21:29:58.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:08.990+0000 7fb4d7321700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:30:08.990+0000 7fb4d7321700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:08.990+0000 7fb4d7321700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:30:08.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:18.990+0000 7fb4ceb10700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:30:18.990+0000 7fb4ceb10700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:18.990+0000 7fb4ceb10700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:30:18.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:20.950+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:30:28.991+0000 7fb4c7b02700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:30:28.991+0000 7fb4c7b02700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:28.991+0000 7fb4c7b02700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:30:28.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:38.991+0000 7fb4c0af4700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:30:38.991+0000 7fb4c0af4700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:38.991+0000 7fb4c0af4700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:30:38.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:48.991+0000 7fb4b7ae2700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:30:48.991+0000 7fb4b7ae2700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:48.991+0000 7fb4b7ae2700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:30:48.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:30:50.951+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:30:56.387+0000 7fb4b8ae4700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:30:56.387+0000 7fb4b8ae4700 0 req 10767244766825987679 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:30:57.415+0000 7fb4b8ae4700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.028028131s ====== debug 2026-03-25T21:30:57.415+0000 7fb4b8ae4700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:30:56.387 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028028131s debug 2026-03-25T21:30:57.419+0000 7fb4d5b1e700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:30:57.419+0000 7fb4d5b1e700 0 req 16509517134624360802 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:30:57.443+0000 7fb4ab2c9700 1 ====== req done req=0x7fb491213730 op status=-2 http_status=204 latency=0.024000656s ====== debug 2026-03-25T21:30:57.443+0000 7fb4ab2c9700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:30:57.419 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000656s debug 2026-03-25T21:30:57.443+0000 7fb4a92c5700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:30:57.443+0000 7fb4a92c5700 0 req 10610619952332496927 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:30:57.471+0000 7fb4a72c1700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.028000765s ====== debug 2026-03-25T21:30:57.471+0000 7fb4a72c1700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:30:57.443 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000765s debug 2026-03-25T21:30:57.475+0000 7fb4a9ac6700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:30:57.475+0000 7fb4a9ac6700 0 req 1636152561770000716 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:30:57.511+0000 7fb4a1ab6700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.036000986s ====== debug 2026-03-25T21:30:57.511+0000 7fb4a1ab6700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:30:57.475 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000986s debug 2026-03-25T21:30:57.511+0000 7fb4a52bd700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:30:57.511+0000 7fb4a52bd700 0 req 16329393509025033887 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:30:57.539+0000 7fb49e2af700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.028000765s ====== debug 2026-03-25T21:30:57.539+0000 7fb49e2af700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:30:57.511 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000765s debug 2026-03-25T21:30:57.579+0000 7fb4a02b3700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:30:57.579+0000 7fb4a02b3700 0 req 14810998056557270539 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:30:57.615+0000 7fb4972a1700 1 ====== req done req=0x7fb491213730 op status=0 http_status=204 latency=0.036000986s ====== debug 2026-03-25T21:30:57.615+0000 7fb4972a1700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:30:57.579 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000986s debug 2026-03-25T21:30:58.987+0000 7fb592497700 1 ====== starting new request req=0x7fb491090730 ===== debug 2026-03-25T21:30:58.987+0000 7fb592497700 1 ====== req done req=0x7fb491090730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:30:58.987+0000 7fb592497700 1 beast: 0x7fb491090730: 10.0.0.187 - - [25/Mar/2026:21:30:58.987 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:08.988+0000 7fb593c9a700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:31:08.988+0000 7fb593c9a700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:08.988+0000 7fb593c9a700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:31:08.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:18.988+0000 7fb57ec70700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:31:18.988+0000 7fb57ec70700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:18.988+0000 7fb57ec70700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:31:18.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:20.952+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:31:28.988+0000 7fb57bc6a700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:31:28.988+0000 7fb57bc6a700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:28.988+0000 7fb57bc6a700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:31:28.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:38.989+0000 7fb571455700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:31:38.989+0000 7fb571455700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:38.989+0000 7fb571455700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:31:38.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:48.989+0000 7fb56c44b700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:31:48.989+0000 7fb56c44b700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:48.989+0000 7fb56c44b700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:31:48.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:31:50.957+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:31:57.629+0000 7fb572c58700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:31:57.629+0000 7fb572c58700 0 req 12808353101815844254 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:31:58.669+0000 7fb572c58700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.040028334s ====== debug 2026-03-25T21:31:58.669+0000 7fb572c58700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:31:57.629 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040028334s debug 2026-03-25T21:31:58.673+0000 7fb56f451700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:31:58.673+0000 7fb56f451700 0 req 6994646055604445653 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:31:58.705+0000 7fb55ec30700 1 ====== req done req=0x7fb491192730 op status=-2 http_status=204 latency=0.032000873s ====== debug 2026-03-25T21:31:58.705+0000 7fb55ec30700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:31:58.673 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:31:58.705+0000 7fb560c34700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:31:58.705+0000 7fb560c34700 0 req 9989672264352451188 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:31:58.745+0000 7fb561435700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.040001087s ====== debug 2026-03-25T21:31:58.745+0000 7fb561435700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:31:58.705 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040001087s debug 2026-03-25T21:31:58.745+0000 7fb55d42d700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:31:58.745+0000 7fb55d42d700 0 req 18338858731930550745 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:31:58.793+0000 7fb55641f700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.048001308s ====== debug 2026-03-25T21:31:58.793+0000 7fb55641f700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:31:58.745 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.048001308s debug 2026-03-25T21:31:58.793+0000 7fb559425700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:31:58.793+0000 7fb559425700 0 req 3493171383288702348 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:31:58.817+0000 7fb552c18700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.024000654s ====== debug 2026-03-25T21:31:58.817+0000 7fb552c18700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:31:58.793 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000654s debug 2026-03-25T21:31:58.861+0000 7fb553c1a700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:31:58.861+0000 7fb553c1a700 0 req 1596422063911713722 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:31:58.889+0000 7fb54ac08700 1 ====== req done req=0x7fb491192730 op status=0 http_status=204 latency=0.028000763s ====== debug 2026-03-25T21:31:58.889+0000 7fb54ac08700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:31:58.861 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000763s debug 2026-03-25T21:31:58.989+0000 7fb548c04700 1 ====== starting new request req=0x7fb491090730 ===== debug 2026-03-25T21:31:58.989+0000 7fb548c04700 1 ====== req done req=0x7fb491090730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:31:58.989+0000 7fb548c04700 1 beast: 0x7fb491090730: 10.0.0.187 - - [25/Mar/2026:21:31:58.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:08.989+0000 7fb5403f3700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:32:08.989+0000 7fb5403f3700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:08.989+0000 7fb5403f3700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:32:08.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:18.990+0000 7fb537be2700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:32:18.990+0000 7fb537be2700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:18.990+0000 7fb537be2700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:32:18.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:20.958+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:32:28.990+0000 7fb531bd6700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:32:28.990+0000 7fb531bd6700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:28.990+0000 7fb531bd6700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:32:28.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:38.990+0000 7fb5313d5700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:32:38.990+0000 7fb5313d5700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:38.990+0000 7fb5313d5700 1 beast: 0x7fb491213730: 10.0.0.187 - - [25/Mar/2026:21:32:38.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:48.990+0000 7fb521bb6700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:32:48.990+0000 7fb521bb6700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:48.990+0000 7fb521bb6700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:32:48.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:50.966+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:32:58.903+0000 7fb5213b5700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:32:58.903+0000 7fb5213b5700 0 req 11417571684797671999 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:32:58.991+0000 7fb51bbaa700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:32:58.991+0000 7fb51bbaa700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:32:58.991+0000 7fb51bbaa700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:32:58.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:32:59.931+0000 7fb511395700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.028028011s ====== debug 2026-03-25T21:32:59.931+0000 7fb511395700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:32:58.903 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028028011s debug 2026-03-25T21:32:59.931+0000 7fb515b9e700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:32:59.931+0000 7fb515b9e700 0 req 2143974850097621112 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:32:59.951+0000 7fb50ab88700 1 ====== req done req=0x7fb491213730 op status=-2 http_status=204 latency=0.020000543s ====== debug 2026-03-25T21:32:59.951+0000 7fb50ab88700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:32:59.931 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000543s debug 2026-03-25T21:32:59.951+0000 7fb509385700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:32:59.951+0000 7fb509385700 0 req 96413815268726702 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:32:59.983+0000 7fb50db8e700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.032000873s ====== debug 2026-03-25T21:32:59.983+0000 7fb50db8e700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:32:59.951 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:32:59.983+0000 7fb509b86700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:32:59.983+0000 7fb509b86700 0 req 13269188567711536849 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:33:00.019+0000 7fb503379700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.036000978s ====== debug 2026-03-25T21:33:00.019+0000 7fb503379700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:32:59.983 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000978s debug 2026-03-25T21:33:00.019+0000 7fb50637f700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:33:00.019+0000 7fb50637f700 0 req 15284820194285716201 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:33:00.043+0000 7fb4ffb72700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.024000654s ====== debug 2026-03-25T21:33:00.043+0000 7fb4ffb72700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:33:00.019 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000654s debug 2026-03-25T21:33:00.087+0000 7fb4fbb6a700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:33:00.087+0000 7fb4fbb6a700 0 req 4394098444258071368 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:33:00.123+0000 7fb4f9b66700 1 ====== req done req=0x7fb491213730 op status=0 http_status=204 latency=0.036000978s ====== debug 2026-03-25T21:33:00.123+0000 7fb4f9b66700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:33:00.087 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000978s debug 2026-03-25T21:33:08.991+0000 7fb4f3b5a700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:33:08.991+0000 7fb4f3b5a700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:08.991+0000 7fb4f3b5a700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:33:08.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:33:18.991+0000 7fb4f0b54700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:33:18.991+0000 7fb4f0b54700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:18.991+0000 7fb4f0b54700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:33:18.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:33:20.967+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:33:28.988+0000 7fb4e6b40700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:33:28.988+0000 7fb4e6b40700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:28.988+0000 7fb4e6b40700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:33:28.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:33:38.988+0000 7fb4db329700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:33:38.988+0000 7fb4db329700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:38.988+0000 7fb4db329700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:33:38.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:33:48.988+0000 7fb4dfb32700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:33:48.988+0000 7fb4dfb32700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:48.988+0000 7fb4dfb32700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:33:48.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:33:50.968+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:33:58.988+0000 7fb4d0313700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:33:58.988+0000 7fb4d0313700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:33:58.988+0000 7fb4d0313700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:33:58.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:00.132+0000 7fb4cd30d700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:34:00.132+0000 7fb4cd30d700 0 req 10118686991940092390 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:34:01.164+0000 7fb4cd30d700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.032028079s ====== debug 2026-03-25T21:34:01.164+0000 7fb4cd30d700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:34:00.132 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032028079s debug 2026-03-25T21:34:01.168+0000 7fb4c32f9700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:34:01.168+0000 7fb4c32f9700 0 req 3813768062300945744 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:34:01.200+0000 7fb4c22f7700 1 ====== req done req=0x7fb491192730 op status=-2 http_status=204 latency=0.032000873s ====== debug 2026-03-25T21:34:01.200+0000 7fb4c22f7700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:34:01.168 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:34:01.200+0000 7fb4ca307700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:34:01.200+0000 7fb4ca307700 0 req 15358422366381076751 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:34:01.236+0000 7fb4bd2ed700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.036000978s ====== debug 2026-03-25T21:34:01.236+0000 7fb4bd2ed700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:34:01.200 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000978s debug 2026-03-25T21:34:01.236+0000 7fb4c7b02700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:34:01.236+0000 7fb4c7b02700 0 req 1458219124637812983 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:34:01.280+0000 7fb4b92e5700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.044001199s ====== debug 2026-03-25T21:34:01.280+0000 7fb4b92e5700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:34:01.236 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001199s debug 2026-03-25T21:34:01.280+0000 7fb4bbaea700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:34:01.280+0000 7fb4bbaea700 0 req 10804028466710000466 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:34:01.304+0000 7fb4b42db700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.024000652s ====== debug 2026-03-25T21:34:01.304+0000 7fb4b42db700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:34:01.280 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000652s debug 2026-03-25T21:34:01.348+0000 7fb4b52dd700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:34:01.348+0000 7fb4b52dd700 0 req 2777944854122938812 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:34:01.388+0000 7fb4b02d3700 1 ====== req done req=0x7fb491192730 op status=0 http_status=204 latency=0.040001087s ====== debug 2026-03-25T21:34:01.388+0000 7fb4b02d3700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:34:01.348 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040001087s debug 2026-03-25T21:34:08.989+0000 7fb4aaac8700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:34:08.989+0000 7fb4aaac8700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:08.989+0000 7fb4aaac8700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:34:08.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:18.989+0000 7fb4a9ac6700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:34:18.989+0000 7fb4a9ac6700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:18.989+0000 7fb4a9ac6700 1 beast: 0x7fb491213730: 10.0.0.187 - - [25/Mar/2026:21:34:18.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:20.969+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:34:28.989+0000 7fb49caac700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:34:28.989+0000 7fb49caac700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:28.989+0000 7fb49caac700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:34:28.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:38.989+0000 7fb4982a3700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:34:38.989+0000 7fb4982a3700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:38.989+0000 7fb4982a3700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:34:38.989 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:48.990+0000 7fb594c9c700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:34:48.990+0000 7fb594c9c700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:48.990+0000 7fb594c9c700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:34:48.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:34:50.978+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:34:58.990+0000 7fb585c7e700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:34:58.990+0000 7fb585c7e700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:34:58.990+0000 7fb585c7e700 1 beast: 0x7fb491213730: 10.0.0.187 - - [25/Mar/2026:21:34:58.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:01.402+0000 7fb58647f700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:35:01.402+0000 7fb58647f700 0 req 15020680614986159881 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:35:02.442+0000 7fb58647f700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.040028334s ====== debug 2026-03-25T21:35:02.442+0000 7fb58647f700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:35:01.402 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040028334s debug 2026-03-25T21:35:02.446+0000 7fb57dc6e700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:35:02.446+0000 7fb57dc6e700 0 req 8415832984490793795 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:35:02.466+0000 7fb57ec70700 1 ====== req done req=0x7fb491213730 op status=-2 http_status=204 latency=0.020000543s ====== debug 2026-03-25T21:35:02.466+0000 7fb57ec70700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:35:02.446 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000543s debug 2026-03-25T21:35:02.470+0000 7fb57cc6c700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:35:02.470+0000 7fb57cc6c700 0 req 1560925573651795906 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:35:02.498+0000 7fb576c60700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.028000763s ====== debug 2026-03-25T21:35:02.498+0000 7fb576c60700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:35:02.470 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000763s debug 2026-03-25T21:35:02.498+0000 7fb57a467700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:35:02.498+0000 7fb57a467700 0 req 8966511788301314119 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:35:02.534+0000 7fb57f471700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.036000978s ====== debug 2026-03-25T21:35:02.534+0000 7fb57f471700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:35:02.498 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000978s debug 2026-03-25T21:35:02.534+0000 7fb57f471700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:35:02.534+0000 7fb57f471700 0 req 14380191035810197473 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:35:02.562+0000 7fb56d44d700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.028000765s ====== debug 2026-03-25T21:35:02.562+0000 7fb56d44d700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:35:02.534 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000765s debug 2026-03-25T21:35:02.606+0000 7fb56b449700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:35:02.606+0000 7fb56b449700 0 req 10067388162545825192 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:35:02.638+0000 7fb566c40700 1 ====== req done req=0x7fb491213730 op status=0 http_status=204 latency=0.032000873s ====== debug 2026-03-25T21:35:02.638+0000 7fb566c40700 1 beast: 0x7fb491213730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:35:02.606 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000873s debug 2026-03-25T21:35:08.990+0000 7fb567c42700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:35:08.990+0000 7fb567c42700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:08.990+0000 7fb567c42700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:35:08.990 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:18.991+0000 7fb55ec30700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:35:18.991+0000 7fb55ec30700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:18.991+0000 7fb55ec30700 1 beast: 0x7fb491192730: 10.0.0.187 - - [25/Mar/2026:21:35:18.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:20.979+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:35:28.991+0000 7fb552417700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:35:28.991+0000 7fb552417700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:28.991+0000 7fb552417700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:35:28.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:38.991+0000 7fb551c16700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:35:38.991+0000 7fb551c16700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:38.991+0000 7fb551c16700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:35:38.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:48.991+0000 7fb54bc0a700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:35:48.991+0000 7fb54bc0a700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:48.991+0000 7fb54bc0a700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:35:48.991 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:35:50.983+0000 7fb5c519f700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-25T21:35:58.988+0000 7fb5423f7700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:35:58.988+0000 7fb5423f7700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:35:58.988+0000 7fb5423f7700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:35:58.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:36:02.648+0000 7fb543bfa700 1 ====== starting new request req=0x7fb491a95730 ===== debug 2026-03-25T21:36:02.648+0000 7fb543bfa700 0 req 8464134137330054310 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-25T21:36:03.676+0000 7fb543bfa700 1 ====== req done req=0x7fb491a95730 op status=0 http_status=200 latency=1.028027892s ====== debug 2026-03-25T21:36:03.676+0000 7fb543bfa700 1 beast: 0x7fb491a95730: 10.0.0.58 - rgw-admin-ops-user [25/Mar/2026:21:36:02.648 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028027892s debug 2026-03-25T21:36:03.680+0000 7fb53ebf0700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:36:03.680+0000 7fb53ebf0700 0 req 13871499660491698918 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:36:03.704+0000 7fb5383e3700 1 ====== req done req=0x7fb491192730 op status=-2 http_status=204 latency=0.024000650s ====== debug 2026-03-25T21:36:03.704+0000 7fb5383e3700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:36:03.680 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000650s debug 2026-03-25T21:36:03.704+0000 7fb534bdc700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:36:03.704+0000 7fb534bdc700 0 req 11370681639473675449 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-25T21:36:03.732+0000 7fb5353dd700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.028000761s ====== debug 2026-03-25T21:36:03.732+0000 7fb5353dd700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:36:03.704 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000761s debug 2026-03-25T21:36:03.732+0000 7fb53cbec700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:36:03.732+0000 7fb53cbec700 0 req 7993364873360775596 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-25T21:36:03.768+0000 7fb5293c5700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.036000974s ====== debug 2026-03-25T21:36:03.768+0000 7fb5293c5700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:36:03.732 +0000] "PUT /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000974s debug 2026-03-25T21:36:03.772+0000 7fb52dbce700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:36:03.772+0000 7fb52dbce700 0 req 2555287355656271142 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-25T21:36:03.796+0000 7fb5323d7700 1 ====== req done req=0x7fb491192730 op status=0 http_status=200 latency=0.024000652s ====== debug 2026-03-25T21:36:03.796+0000 7fb5323d7700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:36:03.772 +0000] "GET /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000652s debug 2026-03-25T21:36:03.840+0000 7fb52e3cf700 1 ====== starting new request req=0x7fb491192730 ===== debug 2026-03-25T21:36:03.840+0000 7fb52e3cf700 0 req 14629349359888639855 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-25T21:36:03.872+0000 7fb5263bf700 1 ====== req done req=0x7fb491192730 op status=0 http_status=204 latency=0.032000870s ====== debug 2026-03-25T21:36:03.872+0000 7fb5263bf700 1 beast: 0x7fb491192730: 10.0.0.58 - rook-ceph-internal-s3-user-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f [25/Mar/2026:21:36:03.840 +0000] "DELETE /rook-ceph-bucket-checker-3f9c543d-fc24-4ebb-8249-e014e36e904f/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000870s debug 2026-03-25T21:36:08.988+0000 7fb51e3af700 1 ====== starting new request req=0x7fb491213730 ===== debug 2026-03-25T21:36:08.988+0000 7fb51e3af700 1 ====== req done req=0x7fb491213730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:36:08.988+0000 7fb51e3af700 1 beast: 0x7fb491213730: 10.0.0.187 - - [25/Mar/2026:21:36:08.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-25T21:36:18.988+0000 7fb51539d700 1 ====== starting new request req=0x7fb491111730 ===== debug 2026-03-25T21:36:18.988+0000 7fb51539d700 1 ====== req done req=0x7fb491111730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-25T21:36:18.988+0000 7fb51539d700 1 beast: 0x7fb491111730: 10.0.0.187 - - [25/Mar/2026:21:36:18.988 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s