debug 2026-03-29T02:12:00.861+0000 7f422e203a80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-03-29T02:12:00.861+0000 7f422e203a80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-03-29T02:12:00.861+0000 7f422e203a80 0 framework: beast debug 2026-03-29T02:12:00.861+0000 7f422e203a80 0 framework conf key: port, val: 8080 debug 2026-03-29T02:12:00.861+0000 7f422e203a80 1 init_numa not setting numa affinity debug 2026-03-29T02:12:01.317+0000 7f422e203a80 0 framework: beast debug 2026-03-29T02:12:01.317+0000 7f422e203a80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-03-29T02:12:01.317+0000 7f422e203a80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-03-29T02:12:01.329+0000 7f422e203a80 0 starting handler: beast debug 2026-03-29T02:12:01.329+0000 7f422e203a80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-03-29T02:12:01.349+0000 7f422e203a80 1 mgrc service_daemon_register rgw.14508 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-knxvr,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026,kernel_version=5.15.0-173-generic,mem_swap_kb=0,mem_total_kb=65841448,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-knxvr,pod_namespace=openstack,realm_id=6d829ae9-0ad9-4371-a71a-706beec03c04,realm_name=ceph,zone_id=f31a1f52-b6f4-4434-9120-082b35cfbf73,zone_name=ceph,zonegroup_id=ecc0213c-315b-4d51-9da6-3cf7732efa8d,zonegroup_name=ceph} debug 2026-03-29T02:12:10.782+0000 7f41fe093700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:12:10.786+0000 7f41f8087700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=0.004000092s ====== debug 2026-03-29T02:12:10.786+0000 7f41f8087700 1 beast: 0x7f40f9689730: 10.0.0.74 - - [29/Mar/2026:02:12:10.782 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000092s debug 2026-03-29T02:12:12.366+0000 7f41f4880700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:12:12.366+0000 7f41f4880700 0 req 6169185804866403830 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:12:13.814+0000 7f41f207b700 1 ====== req done req=0x7f40f9689730 op status=-2042 http_status=404 latency=1.448033571s ====== debug 2026-03-29T02:12:13.814+0000 7f41f207b700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:12:12.366 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.448033571s debug 2026-03-29T02:12:13.814+0000 7f41f5081700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:12:13.814+0000 7f41f5081700 0 req 13986148447573072878 0.000000000s :create_user No stored secret string, cache miss debug 2026-03-29T02:12:13.854+0000 7f41ea86c700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=0.040000923s ====== debug 2026-03-29T02:12:13.854+0000 7f41ea86c700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:12:13.814 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042&format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.040000923s debug 2026-03-29T02:12:13.898+0000 7f41ef075700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:12:13.898+0000 7f41ef075700 0 req 13945278636299371764 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:12:13.922+0000 7f41e4860700 1 req 13945278636299371764 0.024000555s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-03-29T02:12:13.922+0000 7f41e4860700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=404 latency=0.024000555s ====== debug 2026-03-29T02:12:13.922+0000 7f41e4860700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:12:13.898 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-29T02:12:13.926+0000 7f41e7866700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:12:13.926+0000 7f41e7866700 0 req 257448839772788894 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:12:13.982+0000 7f41dc04f700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.056001294s ====== debug 2026-03-29T02:12:13.982+0000 7f41dc04f700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:12:13.926 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.056001294s debug 2026-03-29T02:12:13.986+0000 7f41e185a700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:12:13.986+0000 7f41e185a700 0 req 2643020246090780485 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:12:14.030+0000 7f41d4840700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.044001017s ====== debug 2026-03-29T02:12:14.030+0000 7f41d4840700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:12:13.986 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001017s debug 2026-03-29T02:12:14.034+0000 7f41da04b700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:12:14.034+0000 7f41da04b700 0 req 14654599335206489339 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:12:14.058+0000 7f41d0838700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.024000555s ====== debug 2026-03-29T02:12:14.058+0000 7f41d0838700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:12:14.034 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-29T02:12:14.102+0000 7f41d303d700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:12:14.102+0000 7f41d303d700 0 req 17556410976075828405 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:12:14.146+0000 7f41c9029700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=204 latency=0.044001017s ====== debug 2026-03-29T02:12:14.146+0000 7f41c9029700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:12:14.102 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001017s debug 2026-03-29T02:12:20.014+0000 7f41c7826700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:12:20.014+0000 7f41c7826700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:12:20.014+0000 7f41c7826700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:12:20.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:12:30.014+0000 7f41c181a700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:12:30.014+0000 7f41c181a700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:12:30.014+0000 7f41c181a700 1 beast: 0x7f40f8d86730: 10.0.0.74 - - [29/Mar/2026:02:12:30.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:12:31.314+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:12:31.314+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-03-29T02:12:40.014+0000 7f41bb00d700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:12:40.014+0000 7f41bb00d700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:12:40.014+0000 7f41bb00d700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:12:40.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:12:50.014+0000 7f41b37fe700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:12:50.014+0000 7f41b37fe700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:12:50.014+0000 7f41b37fe700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:12:50.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:00.015+0000 7f41b17fa700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:00.015+0000 7f41b17fa700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:00.015+0000 7f41b17fa700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:00.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:01.319+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:13:10.015+0000 7f41a87e8700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:10.015+0000 7f41a87e8700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:10.015+0000 7f41a87e8700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:10.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:14.163+0000 7f41ae7f4700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:13:14.163+0000 7f41ae7f4700 0 req 6822787377559055026 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:13:15.195+0000 7f41ae7f4700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.032023787s ====== debug 2026-03-29T02:13:15.195+0000 7f41ae7f4700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:13:14.163 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.032023787s debug 2026-03-29T02:13:15.199+0000 7f41987c8700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:13:15.199+0000 7f41987c8700 0 req 1281799589425056160 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:13:15.231+0000 7f4195fc3700 1 ====== req done req=0x7f40f8d86730 op status=-2 http_status=204 latency=0.032000735s ====== debug 2026-03-29T02:13:15.231+0000 7f4195fc3700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:13:15.199 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000735s debug 2026-03-29T02:13:15.231+0000 7f4197fc7700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:13:15.231+0000 7f4197fc7700 0 req 11929474754418856376 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:13:15.271+0000 7f4191fbb700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.040000919s ====== debug 2026-03-29T02:13:15.271+0000 7f4191fbb700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:13:15.231 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000919s debug 2026-03-29T02:13:15.271+0000 7f41947c0700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:13:15.271+0000 7f41947c0700 0 req 1541106635569921354 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:13:15.311+0000 7f418d7b2700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.040000919s ====== debug 2026-03-29T02:13:15.311+0000 7f418d7b2700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:13:15.271 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000919s debug 2026-03-29T02:13:15.311+0000 7f41907b8700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:13:15.311+0000 7f41907b8700 0 req 4165311665963105828 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:13:15.339+0000 7f4189fab700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.028000643s ====== debug 2026-03-29T02:13:15.339+0000 7f4189fab700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:13:15.311 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000643s debug 2026-03-29T02:13:15.383+0000 7f418bfaf700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:13:15.383+0000 7f418bfaf700 0 req 14038700343481749606 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:13:15.483+0000 7f418179a700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=204 latency=0.100002304s ====== debug 2026-03-29T02:13:15.483+0000 7f418179a700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:13:15.383 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.100002304s debug 2026-03-29T02:13:20.015+0000 7f417ff97700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:20.015+0000 7f417ff97700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:20.015+0000 7f417ff97700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:20.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:30.015+0000 7f4176784700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:30.015+0000 7f4176784700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:30.015+0000 7f4176784700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:30.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:31.319+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:13:40.016+0000 7f416af6d700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:40.016+0000 7f416af6d700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:40.016+0000 7f416af6d700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:40.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:13:50.016+0000 7f4163f5f700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:13:50.016+0000 7f4163f5f700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:13:50.016+0000 7f4163f5f700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:13:50.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:00.016+0000 7f416bf6f700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:00.016+0000 7f416bf6f700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:00.016+0000 7f416bf6f700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:14:00.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:01.328+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:14:10.016+0000 7f4155f43700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:14:10.016+0000 7f4155f43700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:10.016+0000 7f4155f43700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:14:10.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:15.492+0000 7f4155742700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:14:15.492+0000 7f4155742700 0 req 2522874057566932534 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:14:16.516+0000 7f4155742700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.024023533s ====== debug 2026-03-29T02:14:16.516+0000 7f4155742700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:14:15.492 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.024023533s debug 2026-03-29T02:14:16.556+0000 7f414b72e700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:16.556+0000 7f414b72e700 0 req 15260421651357520763 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:14:16.584+0000 7f4149f2b700 1 ====== req done req=0x7f40f8e07730 op status=-2 http_status=204 latency=0.028000643s ====== debug 2026-03-29T02:14:16.584+0000 7f4149f2b700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:14:16.556 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000643s debug 2026-03-29T02:14:16.584+0000 7f414bf2f700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:16.584+0000 7f414bf2f700 0 req 3357010014713090926 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:14:16.616+0000 7f4145f23700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.032000735s ====== debug 2026-03-29T02:14:16.616+0000 7f4145f23700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:14:16.584 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000735s debug 2026-03-29T02:14:16.620+0000 7f4148728700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:16.620+0000 7f4148728700 0 req 17418370913973802257 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:14:16.656+0000 7f414171a700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.036000829s ====== debug 2026-03-29T02:14:16.656+0000 7f414171a700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:14:16.620 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000829s debug 2026-03-29T02:14:16.656+0000 7f4144720700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:16.656+0000 7f4144720700 0 req 15842761260508596265 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:14:16.680+0000 7f413df13700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.024000552s ====== debug 2026-03-29T02:14:16.680+0000 7f413df13700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:14:16.656 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000552s debug 2026-03-29T02:14:16.724+0000 7f413ff17700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:14:16.724+0000 7f413ff17700 0 req 9904987551093634888 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:14:16.760+0000 7f4135702700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=204 latency=0.036000829s ====== debug 2026-03-29T02:14:16.760+0000 7f4135702700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:14:16.724 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000829s debug 2026-03-29T02:14:20.041+0000 7f4133eff700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:14:20.041+0000 7f4133eff700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:20.041+0000 7f4133eff700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:14:20.041 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:30.013+0000 7f4129eeb700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:14:30.013+0000 7f4129eeb700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:30.013+0000 7f4129eeb700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:14:30.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:31.325+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:14:40.013+0000 7f41236de700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:14:40.013+0000 7f41236de700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:40.013+0000 7f41236de700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:14:40.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:14:50.013+0000 7f411ced1700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:14:50.013+0000 7f411ced1700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:14:50.013+0000 7f411ced1700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:14:50.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:00.013+0000 7f4113ebf700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:15:00.013+0000 7f4113ebf700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:00.013+0000 7f4113ebf700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:15:00.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:01.330+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:15:10.014+0000 7f410deb3700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:15:10.014+0000 7f410deb3700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:10.014+0000 7f410deb3700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:15:10.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:16.770+0000 7f410e6b4700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:15:16.770+0000 7f410e6b4700 0 req 948636362683732317 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:15:17.814+0000 7f410e6b4700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.044024467s ====== debug 2026-03-29T02:15:17.814+0000 7f410e6b4700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:15:16.770 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044024467s debug 2026-03-29T02:15:17.818+0000 7f4100698700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:15:17.818+0000 7f4100698700 0 req 7940596681206472708 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:15:17.870+0000 7f41fc890700 1 ====== req done req=0x7f40f8d86730 op status=-2 http_status=204 latency=0.052001219s ====== debug 2026-03-29T02:15:17.870+0000 7f41fc890700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:15:17.818 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001219s debug 2026-03-29T02:15:17.870+0000 7f40ff696700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:15:17.870+0000 7f40ff696700 0 req 433550098238390687 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:15:17.906+0000 7f41f9089700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.036000844s ====== debug 2026-03-29T02:15:17.906+0000 7f41f9089700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:15:17.870 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000844s debug 2026-03-29T02:15:17.906+0000 7f41f988a700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:15:17.906+0000 7f41f988a700 0 req 12101686180888673589 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:15:17.938+0000 7f41f387e700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.032000750s ====== debug 2026-03-29T02:15:17.938+0000 7f41f387e700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:15:17.906 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000750s debug 2026-03-29T02:15:17.942+0000 7f41f7085700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:15:17.942+0000 7f41f7085700 0 req 6168241654144674703 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:15:17.962+0000 7f41f207b700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.020000467s ====== debug 2026-03-29T02:15:17.962+0000 7f41f207b700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:15:17.942 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000467s debug 2026-03-29T02:15:18.006+0000 7f41f287c700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:15:18.006+0000 7f41f287c700 0 req 13173016477241333892 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:15:18.038+0000 7f41e9069700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=204 latency=0.032000750s ====== debug 2026-03-29T02:15:18.038+0000 7f41e9069700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:15:18.006 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000750s debug 2026-03-29T02:15:20.014+0000 7f41ec870700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:15:20.014+0000 7f41ec870700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:20.014+0000 7f41ec870700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:15:20.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:30.014+0000 7f41dd852700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:15:30.014+0000 7f41dd852700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:30.014+0000 7f41dd852700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:15:30.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:31.330+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:15:40.014+0000 7f41d8047700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:15:40.014+0000 7f41d8047700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:40.014+0000 7f41d8047700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:15:40.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:15:50.015+0000 7f41d0838700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:15:50.015+0000 7f41d0838700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:15:50.015+0000 7f41d0838700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:15:50.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:00.015+0000 7f41cc02f700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:16:00.015+0000 7f41cc02f700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:00.015+0000 7f41cc02f700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:16:00.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:01.339+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:16:10.015+0000 7f41c281c700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:16:10.015+0000 7f41c281c700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:10.015+0000 7f41c281c700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:16:10.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:18.051+0000 7f41c5822700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:16:18.051+0000 7f41c5822700 0 req 17023839296933486890 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:16:19.095+0000 7f41c5822700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.044024467s ====== debug 2026-03-29T02:16:19.095+0000 7f41c5822700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:16:18.051 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044024467s debug 2026-03-29T02:16:19.099+0000 7f41b8007700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:16:19.099+0000 7f41b8007700 0 req 18247908142782105798 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:16:19.131+0000 7f41b07f8700 1 ====== req done req=0x7f40f8e07730 op status=-2 http_status=204 latency=0.032000750s ====== debug 2026-03-29T02:16:19.131+0000 7f41b07f8700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:16:19.099 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000750s debug 2026-03-29T02:16:19.155+0000 7f41af7f6700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:16:19.155+0000 7f41af7f6700 0 req 17821280694791936072 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:16:19.195+0000 7f41ad7f2700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.040000934s ====== debug 2026-03-29T02:16:19.195+0000 7f41ad7f2700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:16:19.155 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-03-29T02:16:19.199+0000 7f41afff7700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:16:19.199+0000 7f41afff7700 0 req 7138431497468771867 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:16:19.239+0000 7f41b17fa700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.040000934s ====== debug 2026-03-29T02:16:19.239+0000 7f41b17fa700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:16:19.199 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-03-29T02:16:19.255+0000 7f41abfef700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:16:19.255+0000 7f41abfef700 0 req 10665352667163836398 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:16:19.279+0000 7f41a57e2700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.024000565s ====== debug 2026-03-29T02:16:19.279+0000 7f41a57e2700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:16:19.255 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000565s debug 2026-03-29T02:16:19.323+0000 7f41a0fd9700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:16:19.323+0000 7f41a0fd9700 0 req 18297328396762483185 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:16:19.355+0000 7f419b7ce700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=204 latency=0.032000750s ====== debug 2026-03-29T02:16:19.355+0000 7f419b7ce700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:16:19.323 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000750s debug 2026-03-29T02:16:20.015+0000 7f419afcd700 1 ====== starting new request req=0x7f40f8c84730 ===== debug 2026-03-29T02:16:20.015+0000 7f419afcd700 1 ====== req done req=0x7f40f8c84730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:20.015+0000 7f419afcd700 1 beast: 0x7f40f8c84730: 10.0.0.74 - - [29/Mar/2026:02:16:20.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:30.016+0000 7f41927bc700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:16:30.016+0000 7f41927bc700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:30.016+0000 7f41927bc700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:16:30.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:31.340+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:16:40.016+0000 7f418b7ae700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:16:40.016+0000 7f418b7ae700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:40.016+0000 7f418b7ae700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:16:40.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:16:50.016+0000 7f418bfaf700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:16:50.016+0000 7f418bfaf700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:16:50.016+0000 7f418bfaf700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:16:50.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:00.016+0000 7f417c790700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:17:00.016+0000 7f417c790700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:00.016+0000 7f417c790700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:17:00.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:01.344+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:17:10.017+0000 7f417377e700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:17:10.017+0000 7f417377e700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:10.017+0000 7f417377e700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:17:10.017 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:19.369+0000 7f417277c700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:17:19.369+0000 7f417277c700 0 req 18334101350554229160 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:17:20.013+0000 7f416f776700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.013+0000 7f416f776700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:20.013+0000 7f416f776700 1 beast: 0x7f40f8d86730: 10.0.0.74 - - [29/Mar/2026:02:17:20.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:20.413+0000 7f416af6d700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.044024229s ====== debug 2026-03-29T02:17:20.413+0000 7f416af6d700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:17:19.369 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044024229s debug 2026-03-29T02:17:20.413+0000 7f416d772700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.417+0000 7f416d772700 0 req 10949085658342677310 0.004000093s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:17:20.441+0000 7f416175a700 1 ====== req done req=0x7f40f8d86730 op status=-2 http_status=204 latency=0.028000651s ====== debug 2026-03-29T02:17:20.441+0000 7f416175a700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:17:20.413 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000651s debug 2026-03-29T02:17:20.441+0000 7f4164f61700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.441+0000 7f4164f61700 0 req 14673677404959549356 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:17:20.469+0000 7f415d752700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.028000651s ====== debug 2026-03-29T02:17:20.469+0000 7f415d752700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:17:20.441 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000651s debug 2026-03-29T02:17:20.473+0000 7f415ff57700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.473+0000 7f415ff57700 0 req 15778069235298322647 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:17:20.501+0000 7f4157f47700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.028000651s ====== debug 2026-03-29T02:17:20.501+0000 7f4157f47700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:17:20.473 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000651s debug 2026-03-29T02:17:20.553+0000 7f415974a700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.553+0000 7f415974a700 0 req 11566286744017168563 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:17:20.581+0000 7f415273c700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.028000651s ====== debug 2026-03-29T02:17:20.581+0000 7f415273c700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:17:20.553 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000651s debug 2026-03-29T02:17:20.581+0000 7f4154f41700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:17:20.581+0000 7f4154f41700 0 req 2018588030317979827 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:17:20.617+0000 7f414e734700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=204 latency=0.036000837s ====== debug 2026-03-29T02:17:20.617+0000 7f414e734700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:17:20.581 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000837s debug 2026-03-29T02:17:30.013+0000 7f4148f29700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:17:30.013+0000 7f4148f29700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:30.013+0000 7f4148f29700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:17:30.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:31.341+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:17:40.013+0000 7f4148728700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:17:40.013+0000 7f4148728700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:40.013+0000 7f4148728700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:17:40.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:17:50.013+0000 7f413af0d700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:17:50.013+0000 7f413af0d700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:17:50.013+0000 7f413af0d700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:17:50.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:00.014+0000 7f41316fa700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:18:00.014+0000 7f41316fa700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:00.014+0000 7f41316fa700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:18:00.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:01.354+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:18:10.014+0000 7f412aeed700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:18:10.014+0000 7f412aeed700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:10.014+0000 7f412aeed700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:18:10.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:20.014+0000 7f4125ee3700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:18:20.014+0000 7f4125ee3700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:20.014+0000 7f4125ee3700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:18:20.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:20.666+0000 7f41266e4700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:18:20.670+0000 7f41266e4700 0 req 9592059392186982025 0.004000093s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:18:21.718+0000 7f41266e4700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.052024484s ====== debug 2026-03-29T02:18:21.718+0000 7f41266e4700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:18:20.666 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.052024484s debug 2026-03-29T02:18:21.722+0000 7f411e6d4700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:18:21.722+0000 7f411e6d4700 0 req 16475435840720569463 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:18:21.770+0000 7f41156c2700 1 ====== req done req=0x7f40f8e07730 op status=-2 http_status=204 latency=0.048001111s ====== debug 2026-03-29T02:18:21.770+0000 7f41156c2700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:18:21.722 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.048001111s debug 2026-03-29T02:18:21.774+0000 7f4119ecb700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:18:21.774+0000 7f4119ecb700 0 req 15617949844857457389 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:18:21.826+0000 7f41126bc700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.052001208s ====== debug 2026-03-29T02:18:21.826+0000 7f41126bc700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:18:21.774 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001208s debug 2026-03-29T02:18:21.826+0000 7f4114ec1700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:18:21.826+0000 7f4114ec1700 0 req 4232892575355453955 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:18:21.866+0000 7f4113ebf700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.040000927s ====== debug 2026-03-29T02:18:21.866+0000 7f4113ebf700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:18:21.826 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000927s debug 2026-03-29T02:18:21.866+0000 7f410feb7700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:18:21.866+0000 7f410feb7700 0 req 10707857885932615968 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:18:21.894+0000 7f4112ebd700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.028000651s ====== debug 2026-03-29T02:18:21.894+0000 7f4112ebd700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:18:21.866 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000651s debug 2026-03-29T02:18:21.938+0000 7f410ceb1700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:18:21.938+0000 7f410ceb1700 0 req 1935190097183167898 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:18:21.970+0000 7f4103e9f700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=204 latency=0.032000743s ====== debug 2026-03-29T02:18:21.970+0000 7f4103e9f700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:18:21.938 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000743s debug 2026-03-29T02:18:30.014+0000 7f4100e99700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:18:30.014+0000 7f4100e99700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:30.014+0000 7f4100e99700 1 beast: 0x7f40f8d86730: 10.0.0.74 - - [29/Mar/2026:02:18:30.014 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:31.354+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:18:40.015+0000 7f41f9089700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:18:40.015+0000 7f41f9089700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:40.015+0000 7f41f9089700 1 beast: 0x7f40f8d86730: 10.0.0.74 - - [29/Mar/2026:02:18:40.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:18:50.015+0000 7f41ea86c700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:18:50.015+0000 7f41ea86c700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:18:50.015+0000 7f41ea86c700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:18:50.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:00.015+0000 7f41e8067700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:19:00.015+0000 7f41e8067700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:00.015+0000 7f41e8067700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:19:00.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:01.363+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:19:10.015+0000 7f41e1059700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:19:10.015+0000 7f41e1059700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:10.015+0000 7f41e1059700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:19:10.015 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:20.016+0000 7f41df856700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:19:20.016+0000 7f41df856700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:20.016+0000 7f41df856700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:19:20.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:21.988+0000 7f41d7846700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:19:21.988+0000 7f41d7846700 0 req 3981782667290221121 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:19:23.048+0000 7f41d7846700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.060024619s ====== debug 2026-03-29T02:19:23.048+0000 7f41d7846700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:19:21.988 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.060024619s debug 2026-03-29T02:19:23.052+0000 7f41d203b700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:19:23.052+0000 7f41d203b700 0 req 15446192709223486414 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:19:23.092+0000 7f41cc830700 1 ====== req done req=0x7f40f8d86730 op status=-2 http_status=204 latency=0.040000927s ====== debug 2026-03-29T02:19:23.092+0000 7f41cc830700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:19:23.052 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000927s debug 2026-03-29T02:19:23.092+0000 7f41c982a700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:19:23.092+0000 7f41c982a700 0 req 65084515278117034 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:19:23.148+0000 7f41c6824700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.056001294s ====== debug 2026-03-29T02:19:23.148+0000 7f41c6824700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:19:23.092 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.056001294s debug 2026-03-29T02:19:23.148+0000 7f41ca02b700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:19:23.148+0000 7f41ca02b700 0 req 5025162731992763946 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:19:23.184+0000 7f41c381e700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.036000833s ====== debug 2026-03-29T02:19:23.184+0000 7f41c381e700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:19:23.148 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000833s debug 2026-03-29T02:19:23.188+0000 7f41c7826700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:19:23.188+0000 7f41c7826700 0 req 10025486732856961067 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:19:23.212+0000 7f41c0017700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.024000555s ====== debug 2026-03-29T02:19:23.212+0000 7f41c0017700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:19:23.188 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-29T02:19:23.260+0000 7f41c1019700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:19:23.260+0000 7f41c1019700 0 req 8546273356024265319 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:19:23.296+0000 7f41b6003700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=204 latency=0.036000837s ====== debug 2026-03-29T02:19:23.296+0000 7f41b6003700 1 beast: 0x7f40f8d86730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:19:23.260 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000837s debug 2026-03-29T02:19:30.016+0000 7f41ba00b700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:19:30.016+0000 7f41ba00b700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:30.016+0000 7f41ba00b700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:19:30.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:31.364+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:19:40.016+0000 7f41afff7700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:19:40.016+0000 7f41afff7700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:40.016+0000 7f41afff7700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:19:40.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:19:50.016+0000 7f41a3fdf700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:19:50.016+0000 7f41a3fdf700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:19:50.016+0000 7f41a3fdf700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:19:50.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:20:00.016+0000 7f419b7ce700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:20:00.016+0000 7f419b7ce700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:20:00.016+0000 7f419b7ce700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:20:00.016 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:20:01.368+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:20:10.013+0000 7f4193fbf700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:10.013+0000 7f4193fbf700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:20:10.013+0000 7f4193fbf700 1 beast: 0x7f40f8e07730: 10.0.0.74 - - [29/Mar/2026:02:20:10.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:20:20.013+0000 7f41927bc700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:20:20.013+0000 7f41927bc700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:20:20.013+0000 7f41927bc700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:20:20.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:20:23.309+0000 7f418c7b0700 1 ====== starting new request req=0x7f40f9689730 ===== debug 2026-03-29T02:20:23.309+0000 7f418c7b0700 0 req 16371862117206090713 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-29T02:20:24.349+0000 7f418c7b0700 1 ====== req done req=0x7f40f9689730 op status=0 http_status=200 latency=1.040024161s ====== debug 2026-03-29T02:20:24.349+0000 7f418c7b0700 1 beast: 0x7f40f9689730: 10.0.0.127 - rgw-admin-ops-user [29/Mar/2026:02:20:23.309 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040024161s debug 2026-03-29T02:20:24.349+0000 7f4180798700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:24.353+0000 7f4180798700 0 req 7083924858600138324 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:20:24.377+0000 7f417ef95700 1 ====== req done req=0x7f40f8e07730 op status=-2 http_status=204 latency=0.024000555s ====== debug 2026-03-29T02:20:24.377+0000 7f417ef95700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:20:24.349 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-29T02:20:24.377+0000 7f418179a700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:24.377+0000 7f418179a700 0 req 4243368956598510954 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-29T02:20:24.409+0000 7f417df93700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.032000743s ====== debug 2026-03-29T02:20:24.409+0000 7f417df93700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:20:24.377 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000743s debug 2026-03-29T02:20:24.409+0000 7f417e794700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:24.409+0000 7f417e794700 0 req 10738396373176358874 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-29T02:20:24.441+0000 7f4175f83700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.032000743s ====== debug 2026-03-29T02:20:24.441+0000 7f4175f83700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:20:24.409 +0000] "PUT /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000743s debug 2026-03-29T02:20:24.445+0000 7f4179f8b700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:24.445+0000 7f4179f8b700 0 req 17209054719122211521 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-29T02:20:24.469+0000 7f4171f7b700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=200 latency=0.024000555s ====== debug 2026-03-29T02:20:24.469+0000 7f4171f7b700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:20:24.445 +0000] "GET /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-29T02:20:24.513+0000 7f4173f7f700 1 ====== starting new request req=0x7f40f8e07730 ===== debug 2026-03-29T02:20:24.513+0000 7f4173f7f700 0 req 11255516236798308285 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-29T02:20:24.565+0000 7f4174780700 1 ====== req done req=0x7f40f8e07730 op status=0 http_status=204 latency=0.052001204s ====== debug 2026-03-29T02:20:24.565+0000 7f4174780700 1 beast: 0x7f40f8e07730: 10.0.0.127 - rook-ceph-internal-s3-user-checker-34815b4d-f582-4a18-9f65-3ade4990e042 [29/Mar/2026:02:20:24.513 +0000] "DELETE /rook-ceph-bucket-checker-34815b4d-f582-4a18-9f65-3ade4990e042/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001204s debug 2026-03-29T02:20:30.013+0000 7f416af6d700 1 ====== starting new request req=0x7f40f8d05730 ===== debug 2026-03-29T02:20:30.013+0000 7f416af6d700 1 ====== req done req=0x7f40f8d05730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:20:30.013+0000 7f416af6d700 1 beast: 0x7f40f8d05730: 10.0.0.74 - - [29/Mar/2026:02:20:30.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-29T02:20:31.365+0000 7f422cd93700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-29T02:20:40.013+0000 7f4160f59700 1 ====== starting new request req=0x7f40f8d86730 ===== debug 2026-03-29T02:20:40.013+0000 7f4160f59700 1 ====== req done req=0x7f40f8d86730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-29T02:20:40.013+0000 7f4160f59700 1 beast: 0x7f40f8d86730: 10.0.0.74 - - [29/Mar/2026:02:20:40.013 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s