Name: kube-prometheus-stack-prometheus-node-exporter-s5ctr Namespace: monitoring Priority: 0 Service Account: kube-prometheus-stack-prometheus-node-exporter Node: instance/199.204.45.144 Start Time: Mon, 08 Jun 2026 15:20:27 +0000 Labels: app.kubernetes.io/component=metrics app.kubernetes.io/instance=kube-prometheus-stack app.kubernetes.io/managed-by=Helm app.kubernetes.io/name=prometheus-node-exporter app.kubernetes.io/part-of=prometheus-node-exporter app.kubernetes.io/version=1.8.1 controller-revision-hash=54454c7764 helm.sh/chart=prometheus-node-exporter-4.36.0 jobLabel=node-exporter pod-template-generation=1 release=kube-prometheus-stack Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true container.apparmor.security.beta.kubernetes.io/node-exporter: unconfined Status: Running IP: 199.204.45.144 IPs: IP: 199.204.45.144 Controlled By: DaemonSet/kube-prometheus-stack-prometheus-node-exporter Containers: node-exporter: Container ID: containerd://d340e88386830444e059b66de19bb4d13422fb1d4763f54be376be5a12d231fe Image: harbor.atmosphere.dev/quay.io/prometheus/node-exporter:v1.8.1 Image ID: harbor.atmosphere.dev/quay.io/prometheus/node-exporter@sha256:fa7fa12a57eff607176d5c363d8bb08dfbf636b36ac3cb5613a202f3c61a6631 Port: 9100/TCP Host Port: 9100/TCP Args: --path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --path.udev.data=/host/root/run/udev/data --web.listen-address=[$(HOST_IP)]:9100 --collector.diskstats.ignored-devices=^(ram|loop|nbd|fd|(h|s|v|xv)d[a-z]|nvme\\d+n\\d+p)\\d+$ --collector.filesystem.fs-types-exclude=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|fuse.squashfuse_ll|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ --collector.filesystem.mount-points-exclude=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|var/lib/kubelet/plugins/kubernetes.io/csi/.+|run/containerd/.+)($|/) --collector.ethtool --collector.netclass.ignored-devices=^(lxc|cilium_(host|net)|qbr|qvb|qvo|tap|ovs-system|br|tbr|gre_sys|[0-9a-f]+_eth|vxlan).*$ --collector.netdev.device-exclude=^(lxc|cilium_(host|net)|qbr|qvb|qvo|tap|ovs-system|br|tbr|gre_sys|[0-9a-f]+_eth|vxlan).*$ --collector.processes --collector.systemd --collector.stat.softirq --collector.textfile.directory=/run/prometheus --web.config.file=/config/node-exporter.yml State: Running Started: Mon, 08 Jun 2026 15:21:02 +0000 Last State: Terminated Reason: Error Exit Code: 1 Started: Mon, 08 Jun 2026 15:20:41 +0000 Finished: Mon, 08 Jun 2026 15:20:41 +0000 Ready: True Restart Count: 2 Liveness: http-get https://:9100/ delay=0s timeout=1s period=10s #success=1 #failure=3 Readiness: http-get https://:9100/ delay=0s timeout=1s period=10s #success=1 #failure=3 Environment: HOST_IP: 0.0.0.0 Mounts: /certs from certs (ro) /config from kube-prometheus-stack-node-exporter (rw) /host/proc from proc (ro) /host/root from root (ro) /host/sys from sys (ro) /run/prometheus from node-exporter-textfiles (ro) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hwjmf (ro) pod-tls-sidecar: Container ID: containerd://b32a11077804cb4554a4372a85f0a580b252c2ba2f690687752c0e3613fe884e Image: harbor.atmosphere.dev/ghcr.io/vexxhost/pod-tls-sidecar:v1.0.0 Image ID: harbor.atmosphere.dev/ghcr.io/vexxhost/pod-tls-sidecar@sha256:7a030f8b86c1503006e7d82312a3c8e98769c3b8e3a2e834aee3c60df184161a Port: Host Port: Args: --template=/config/certificate-template.yml --ca-path=/certs/ca.crt --cert-path=/certs/tls.crt --key-path=/certs/tls.key State: Running Started: Mon, 08 Jun 2026 15:20:40 +0000 Ready: True Restart Count: 0 Environment: POD_UID: (v1:metadata.uid) POD_NAME: kube-prometheus-stack-prometheus-node-exporter-s5ctr (v1:metadata.name) POD_NAMESPACE: monitoring (v1:metadata.namespace) POD_IP: (v1:status.podIP) Mounts: /certs from certs (rw) /config from kube-prometheus-stack-node-exporter (rw) /run/prometheus from node-exporter-textfiles (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hwjmf (ro) mountinfo-textfile-collector: Container ID: containerd://831ad571642ae1920b2b29a08c6a6e7a595f5c6a2f597d497ffd84d61dbcbd05 Image: harbor.atmosphere.dev/ghcr.io/containerd/busybox:1.36 Image ID: harbor.atmosphere.dev/ghcr.io/containerd/busybox@sha256:7b3ccabffc97de872a30dfd234fd972a66d247c8cfc69b0550f276481852627c Port: Host Port: Command: /bin/sh -ec while true; do tmp="/run/prometheus/libvirt-mounts.prom.$$" awk ' function suspicious(target) { return target ~ /^\/etc\/ceph(\/|$)/ || target ~ /^\/var\/lib\/kubelet\/pods\/[^\/]+\/volumes\/kubernetes\.io~host-path\/etcceph(\/|$)/ || target ~ /^\/var\/lib\/kubelet\/pods\/[^\/]+\/volume-subpaths\/(ceph-etc|ceph-keyring|ceph-admin-keyring|external-ceph-keyring|ceph-keyring-[^\/]+)(\/|$)/ } { total++ target = $5 if (suspicious(target)) { count[target]++ } } END { duplicate = 0 max = 0 targets = 0 for (target in count) { targets++ if (count[target] > max) { max = count[target] } if (count[target] > 1) { duplicate += count[target] - 1 } } print "# HELP node_libvirt_ceph_mount_duplicate_entries Number of extra duplicate libvirt Ceph-related mountinfo entries." print "# TYPE node_libvirt_ceph_mount_duplicate_entries gauge" print "node_libvirt_ceph_mount_duplicate_entries " duplicate print "# HELP node_libvirt_ceph_mount_max_duplicates Maximum mountinfo entries seen for a single libvirt Ceph-related mount target." print "# TYPE node_libvirt_ceph_mount_max_duplicates gauge" print "node_libvirt_ceph_mount_max_duplicates " max print "# HELP node_libvirt_ceph_mount_targets Number of libvirt Ceph-related mount targets seen in mountinfo." print "# TYPE node_libvirt_ceph_mount_targets gauge" print "node_libvirt_ceph_mount_targets " targets print "# HELP node_mountinfo_entries Number of entries in /proc/1/mountinfo." print "# TYPE node_mountinfo_entries gauge" print "node_mountinfo_entries " total } ' /host/proc/1/mountinfo > "${tmp}" mv "${tmp}" /run/prometheus/libvirt-mounts.prom sleep 60 done State: Running Started: Mon, 08 Jun 2026 15:20:41 +0000 Ready: True Restart Count: 0 Environment: Mounts: /certs from certs (rw) /host/proc from proc (ro) /run/prometheus from node-exporter-textfiles (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hwjmf (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: proc: Type: HostPath (bare host directory volume) Path: /proc HostPathType: sys: Type: HostPath (bare host directory volume) Path: /sys HostPathType: root: Type: HostPath (bare host directory volume) Path: / HostPathType: certs: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: Memory SizeLimit: node-exporter-textfiles: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: Memory SizeLimit: kube-prometheus-stack-node-exporter: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-prometheus-stack-node-exporter Optional: false kube-api-access-hwjmf: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: kubernetes.io/os=linux Tolerations: :NoSchedule op=Exists node.kubernetes.io/disk-pressure:NoSchedule op=Exists node.kubernetes.io/memory-pressure:NoSchedule op=Exists node.kubernetes.io/network-unavailable:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists node.kubernetes.io/pid-pressure:NoSchedule op=Exists node.kubernetes.io/unreachable:NoExecute op=Exists node.kubernetes.io/unschedulable:NoSchedule op=Exists Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Pulling 8m26s kubelet Pulling image "harbor.atmosphere.dev/quay.io/prometheus/node-exporter:v1.8.1" Normal Scheduled 8m26s default-scheduler Successfully assigned monitoring/kube-prometheus-stack-prometheus-node-exporter-s5ctr to instance Normal Pulled 8m25s kubelet Successfully pulled image "harbor.atmosphere.dev/quay.io/prometheus/node-exporter:v1.8.1" in 972ms (972ms including waiting) Normal Pulling 8m24s kubelet Pulling image "harbor.atmosphere.dev/ghcr.io/vexxhost/pod-tls-sidecar:v1.0.0" Normal Pulled 8m13s kubelet Container image "harbor.atmosphere.dev/ghcr.io/containerd/busybox:1.36" already present on machine Normal Pulled 8m13s kubelet Successfully pulled image "harbor.atmosphere.dev/ghcr.io/vexxhost/pod-tls-sidecar:v1.0.0" in 6.96s (11.833s including waiting) Normal Created 8m13s kubelet Created container pod-tls-sidecar Normal Started 8m13s kubelet Started container pod-tls-sidecar Normal Created 8m12s kubelet Created container mountinfo-textfile-collector Normal Started 8m12s kubelet Started container mountinfo-textfile-collector Warning Unhealthy 8m11s kubelet Readiness probe failed: Get "https://199.204.45.144:9100/": dial tcp 199.204.45.144:9100: connect: connection refused Warning BackOff 8m6s (x3 over 8m10s) kubelet Back-off restarting failed container node-exporter in pod kube-prometheus-stack-prometheus-node-exporter-s5ctr_monitoring(a0930595-cfac-4285-9731-c4acec175469) Normal Started 7m51s (x3 over 8m24s) kubelet Started container node-exporter Normal Created 7m51s (x3 over 8m25s) kubelet Created container node-exporter Normal Pulled 7m51s (x2 over 8m12s) kubelet Container image "harbor.atmosphere.dev/quay.io/prometheus/node-exporter:v1.8.1" already present on machine