Name: kube-prometheus-stack-grafana-69bcb9589c-5hr9n Namespace: monitoring Priority: 0 Service Account: kube-prometheus-stack-grafana Node: instance/199.204.45.33 Start Time: Sat, 09 May 2026 01:39:20 +0000 Labels: app.kubernetes.io/instance=kube-prometheus-stack app.kubernetes.io/name=grafana pod-template-hash=69bcb9589c Annotations: checksum/config: aa8142fdd082c30fcaf292b63d10b343cc928141a752a42633083b2ac13c743f checksum/sc-dashboard-provider-config: 593c0a8778b83f11fe80ccb21dfb20bc46705e2be3178df1dc4c89d164c8cd9c checksum/secret: 2111dc17068fbe3386a682f83cfd3c75b2b7681e3abd93e206ffd022bd8a1ea3 kubectl.kubernetes.io/default-container: grafana Status: Running IP: 10.0.0.135 IPs: IP: 10.0.0.135 Controlled By: ReplicaSet/kube-prometheus-stack-grafana-69bcb9589c Containers: grafana-sc-dashboard: Container ID: containerd://d77d1ea528a4d1adee08d235f2db0a621e3357cbf4f49a0442875014daee50c3 Image: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1 Image ID: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar@sha256:b8d5067137fec093cf48670dc3a1dbb38f9e734f3a6683015c2e89a45db5fd16 Port: Host Port: SeccompProfile: RuntimeDefault State: Running Started: Sat, 09 May 2026 01:39:28 +0000 Ready: True Restart Count: 0 Environment: METHOD: WATCH LABEL: grafana_dashboard LABEL_VALUE: 1 FOLDER: /tmp/dashboards RESOURCE: both NAMESPACE: ALL REQ_USERNAME: Optional: false REQ_PASSWORD: Optional: false REQ_URL: http://localhost:3000/api/admin/provisioning/dashboards/reload REQ_METHOD: POST Mounts: /tmp/dashboards from sc-dashboard-volume (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cmnxj (ro) grafana-sc-datasources: Container ID: containerd://e7ca0955677d684889b801b514816f49938e069522fc4d5902c448ad3149fd0f Image: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1 Image ID: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar@sha256:b8d5067137fec093cf48670dc3a1dbb38f9e734f3a6683015c2e89a45db5fd16 Port: Host Port: SeccompProfile: RuntimeDefault State: Running Started: Sat, 09 May 2026 01:39:28 +0000 Ready: True Restart Count: 0 Environment: METHOD: WATCH LABEL: grafana_datasource LABEL_VALUE: 1 FOLDER: /etc/grafana/provisioning/datasources RESOURCE: both REQ_USERNAME: Optional: false REQ_PASSWORD: Optional: false REQ_URL: http://localhost:3000/api/admin/provisioning/datasources/reload REQ_METHOD: POST Mounts: /etc/grafana/provisioning/datasources from sc-datasources-volume (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cmnxj (ro) grafana: Container ID: containerd://8cf93928d569aeec7cecf767a00093bc31b3a350360563b7a18e3fac11ee7c7d Image: harbor.atmosphere.dev/docker.io/grafana/grafana:10.4.0 Image ID: harbor.atmosphere.dev/docker.io/grafana/grafana@sha256:f9811e4e687ffecf1a43adb9b64096c50bc0d7a782f8608530f478b6542de7d5 Ports: 3000/TCP, 9094/TCP, 9094/UDP Host Ports: 0/TCP, 0/TCP, 0/UDP SeccompProfile: RuntimeDefault State: Running Started: Sat, 09 May 2026 01:40:03 +0000 Last State: Terminated Reason: Error Exit Code: 1 Started: Sat, 09 May 2026 01:39:45 +0000 Finished: Sat, 09 May 2026 01:40:02 +0000 Ready: True Restart Count: 1 Liveness: http-get http://:3000/api/health delay=60s timeout=30s period=10s #success=1 #failure=10 Readiness: http-get http://:3000/api/health delay=0s timeout=1s period=10s #success=1 #failure=3 Environment: POD_IP: (v1:status.podIP) GF_SECURITY_ADMIN_USER: Optional: false GF_SECURITY_ADMIN_PASSWORD: Optional: false GF_PATHS_DATA: /var/lib/grafana/ GF_PATHS_LOGS: /var/log/grafana GF_PATHS_PLUGINS: /var/lib/grafana/plugins GF_PATHS_PROVISIONING: /etc/grafana/provisioning Mounts: /etc/grafana/grafana.ini from config (rw,path="grafana.ini") /etc/grafana/provisioning/dashboards/sc-dashboardproviders.yaml from sc-dashboard-provider (rw,path="provider.yaml") /etc/grafana/provisioning/datasources from sc-datasources-volume (rw) /etc/secrets/auth_generic_oauth from auth-generic-oauth-secret-mount (ro) /tmp/dashboards from sc-dashboard-volume (rw) /var/lib/grafana from storage (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cmnxj (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: config: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-prometheus-stack-grafana Optional: false storage: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: sc-dashboard-volume: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: sc-dashboard-provider: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-prometheus-stack-grafana-config-dashboards Optional: false sc-datasources-volume: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: auth-generic-oauth-secret-mount: Type: Secret (a volume populated by a Secret) SecretName: kube-prometheus-stack-grafana-client-secret Optional: false kube-api-access-cmnxj: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: openstack-control-plane=enabled Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 8m23s default-scheduler Successfully assigned monitoring/kube-prometheus-stack-grafana-69bcb9589c-5hr9n to instance Normal Pulling 8m22s kubelet Pulling image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" Normal Created 8m15s kubelet Created container grafana-sc-datasources Normal Created 8m15s kubelet Created container grafana-sc-dashboard Normal Started 8m15s kubelet Started container grafana-sc-dashboard Normal Pulled 8m15s kubelet Container image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" already present on machine Normal Pulled 8m15s kubelet Successfully pulled image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" in 3.379s (6.794s including waiting) Normal Started 8m15s kubelet Started container grafana-sc-datasources Normal Pulling 8m15s kubelet Pulling image "harbor.atmosphere.dev/docker.io/grafana/grafana:10.4.0" Normal Pulled 7m58s kubelet Successfully pulled image "harbor.atmosphere.dev/docker.io/grafana/grafana:10.4.0" in 14.398s (16.622s including waiting) Normal Created 7m40s (x2 over 7m58s) kubelet Created container grafana Normal Started 7m40s (x2 over 7m58s) kubelet Started container grafana Normal Pulled 7m40s kubelet Container image "harbor.atmosphere.dev/docker.io/grafana/grafana:10.4.0" already present on machine Warning Unhealthy 7m38s (x5 over 7m57s) kubelet Readiness probe failed: Get "http://10.0.0.135:3000/api/health": dial tcp 10.0.0.135:3000: connect: connection refused