Name: kube-prometheus-stack-grafana-849bf94b-44gtx Namespace: monitoring Priority: 0 Service Account: kube-prometheus-stack-grafana Node: instance/199.204.45.23 Start Time: Mon, 25 May 2026 00:46:27 +0000 Labels: app.kubernetes.io/instance=kube-prometheus-stack app.kubernetes.io/name=grafana pod-template-hash=849bf94b Annotations: checksum/config: 8109b1da18b65e021411ee32952c78fe59447b79025ca63ac219412c9fddf386 checksum/sc-dashboard-provider-config: e70bf6a851099d385178a76de9757bb0bef8299da6d8443602590e44f05fdf24 checksum/secret: a068703999c8c4147a7e850727c7df3400a7aaea43c7547c7b227d2a32f4e4bc kubectl.kubernetes.io/default-container: grafana Status: Running IP: 10.0.0.74 IPs: IP: 10.0.0.74 Controlled By: ReplicaSet/kube-prometheus-stack-grafana-849bf94b Containers: grafana-sc-dashboard: Container ID: containerd://55255a129e1c0b9f44d9e2519cc545e3b5520a58dbb2ddf558b617dd1c1b6ae1 Image: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1 Image ID: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar@sha256:b8d5067137fec093cf48670dc3a1dbb38f9e734f3a6683015c2e89a45db5fd16 Port: Host Port: SeccompProfile: RuntimeDefault State: Running Started: Mon, 25 May 2026 00:46:35 +0000 Ready: True Restart Count: 0 Environment: METHOD: WATCH LABEL: grafana_dashboard LABEL_VALUE: 1 FOLDER: /tmp/dashboards RESOURCE: both NAMESPACE: ALL REQ_USERNAME: Optional: false REQ_PASSWORD: Optional: false REQ_URL: http://localhost:3000/api/admin/provisioning/dashboards/reload REQ_METHOD: POST Mounts: /tmp/dashboards from sc-dashboard-volume (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hhs29 (ro) grafana-sc-datasources: Container ID: containerd://38cbb5c952a3282b6e171b87df38cf4a24dc49e4795b974224fb45d07e0d3bd4 Image: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1 Image ID: harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar@sha256:b8d5067137fec093cf48670dc3a1dbb38f9e734f3a6683015c2e89a45db5fd16 Port: Host Port: SeccompProfile: RuntimeDefault State: Running Started: Mon, 25 May 2026 00:46:35 +0000 Ready: True Restart Count: 0 Environment: METHOD: WATCH LABEL: grafana_datasource LABEL_VALUE: 1 FOLDER: /etc/grafana/provisioning/datasources RESOURCE: both REQ_USERNAME: Optional: false REQ_PASSWORD: Optional: false REQ_URL: http://localhost:3000/api/admin/provisioning/datasources/reload REQ_METHOD: POST Mounts: /etc/grafana/provisioning/datasources from sc-datasources-volume (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hhs29 (ro) grafana: Container ID: containerd://24ad77bd74fa45a77dac898649f458b48de2d1ef71caf12c977ff504f9d72a87 Image: harbor.atmosphere.dev/docker.io/grafana/grafana:11.0.0 Image ID: harbor.atmosphere.dev/docker.io/grafana/grafana@sha256:0dc5a246ab16bb2c38a349fb588174e832b4c6c2db0981d0c3e6cd774ba66a54 Ports: 3000/TCP, 9094/TCP, 9094/UDP Host Ports: 0/TCP, 0/TCP, 0/UDP SeccompProfile: RuntimeDefault State: Running Started: Mon, 25 May 2026 00:46:41 +0000 Ready: True Restart Count: 0 Liveness: http-get http://:3000/api/health delay=60s timeout=30s period=10s #success=1 #failure=10 Readiness: http-get http://:3000/api/health delay=0s timeout=1s period=10s #success=1 #failure=3 Environment: POD_IP: (v1:status.podIP) GF_SECURITY_ADMIN_USER: Optional: false GF_SECURITY_ADMIN_PASSWORD: Optional: false GF_PATHS_DATA: /var/lib/grafana/ GF_PATHS_LOGS: /var/log/grafana GF_PATHS_PLUGINS: /var/lib/grafana/plugins GF_PATHS_PROVISIONING: /etc/grafana/provisioning Mounts: /etc/grafana/grafana.ini from config (rw,path="grafana.ini") /etc/grafana/provisioning/dashboards/sc-dashboardproviders.yaml from sc-dashboard-provider (rw,path="provider.yaml") /etc/grafana/provisioning/datasources from sc-datasources-volume (rw) /etc/secrets/auth_generic_oauth from auth-generic-oauth-secret-mount (ro) /tmp/dashboards from sc-dashboard-volume (rw) /var/lib/grafana from storage (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hhs29 (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: config: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-prometheus-stack-grafana Optional: false storage: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: sc-dashboard-volume: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: sc-dashboard-provider: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-prometheus-stack-grafana-config-dashboards Optional: false sc-datasources-volume: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: auth-generic-oauth-secret-mount: Type: Secret (a volume populated by a Secret) SecretName: kube-prometheus-stack-grafana-client-secret Optional: false kube-api-access-hhs29: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: openstack-control-plane=enabled Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 7m29s default-scheduler Successfully assigned monitoring/kube-prometheus-stack-grafana-849bf94b-44gtx to instance Warning FailedMount 7m28s kubelet MountVolume.SetUp failed for volume "sc-dashboard-provider" : failed to sync configmap cache: timed out waiting for the condition Warning FailedMount 7m28s kubelet MountVolume.SetUp failed for volume "config" : failed to sync configmap cache: timed out waiting for the condition Warning FailedMount 7m28s kubelet MountVolume.SetUp failed for volume "auth-generic-oauth-secret-mount" : failed to sync secret cache: timed out waiting for the condition Normal Pulling 7m27s kubelet Pulling image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" Normal Pulled 7m21s kubelet Successfully pulled image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" in 2.168s (5.751s including waiting) Normal Created 7m21s kubelet Created container grafana-sc-dashboard Normal Started 7m21s kubelet Started container grafana-sc-dashboard Normal Pulled 7m21s kubelet Container image "harbor.atmosphere.dev/quay.io/kiwigrid/k8s-sidecar:1.26.1" already present on machine Normal Created 7m21s kubelet Created container grafana-sc-datasources Normal Started 7m21s kubelet Started container grafana-sc-datasources Normal Pulling 7m21s kubelet Pulling image "harbor.atmosphere.dev/docker.io/grafana/grafana:11.0.0" Normal Pulled 7m15s kubelet Successfully pulled image "harbor.atmosphere.dev/docker.io/grafana/grafana:11.0.0" in 5.974s (5.974s including waiting) Normal Created 7m15s kubelet Created container grafana Normal Started 7m15s kubelet Started container grafana Warning Unhealthy 7m13s (x2 over 7m14s) kubelet Readiness probe failed: Get "http://10.0.0.74:3000/api/health": dial tcp 10.0.0.74:3000: connect: connection refused