I0218 14:48:55.319940 1 cephcsi.go:171] Driver version: v3.5.1 and Git version: 00f88e58a0b08be3d7ea009a0cfde8dca23021bf I0218 14:48:55.320317 1 cephcsi.go:220] Starting driver type: controller with name: rbd.csi.ceph.com I0218 14:48:55.344772 1 shared_informer.go:270] caches populated I0218 14:48:55.344923 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd.csi.ceph.com-kube-system... I0218 14:48:55.357119 1 leaderelection.go:258] successfully acquired lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:48:55.360369 1 reflector.go:219] Starting reflector *v1.PersistentVolume (10h41m1.408932086s) from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:250 I0218 14:48:55.361329 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:250 I0218 14:48:55.375594 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:48:55.460942 1 shared_informer.go:270] caches populated I0218 14:48:55.461189 1 shared_informer.go:270] caches populated I0218 14:48:57.391828 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:48:59.405036 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:01.427408 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:03.441425 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:05.457838 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:07.476390 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:09.492316 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:11.509851 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:13.532898 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:15.551273 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:17.565581 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:19.579989 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:21.594616 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:23.608745 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:25.631128 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:27.643971 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:29.662242 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:31.684479 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:33.703343 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:35.726475 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:37.739327 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:39.755604 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:41.773606 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:43.787287 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:45.806770 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:47.825040 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:49.839759 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:51.860231 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:53.878317 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:55.896950 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:57.918484 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:49:59.935586 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:01.954525 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:03.972369 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:05.992589 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:08.009987 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:10.029726 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:12.054421 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:14.071238 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:16.087324 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:18.102701 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:20.120010 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:22.139049 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:24.154320 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:26.169000 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:28.182210 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:30.202455 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:32.212488 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:34.228708 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:36.261205 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:38.284402 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:40.297708 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:42.328183 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:44.358907 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:46.456661 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:48.466947 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:50.480445 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:52.526473 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:54.573992 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:56.586519 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:50:58.597561 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:00.610536 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:02.627520 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:04.644700 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:06.665176 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:08.678336 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:10.696979 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:12.714558 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:14.730517 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:16.741221 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:18.757336 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:20.792409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:22.883756 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:24.905644 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:26.921758 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:28.969055 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:30.988698 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:33.004337 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:35.038740 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:37.061560 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:39.080862 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:41.104045 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:43.120719 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:45.135792 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:47.149749 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:49.166789 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:51.181868 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:53.199978 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:54.570820 1 reflector.go:219] Starting reflector *v1.Secret (10h40m18.742427571s) from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:250 I0218 14:51:54.570869 1 reflector.go:255] Listing and watching *v1.Secret from sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:250 I0218 14:51:54.671316 1 shared_informer.go:270] caches populated I0218 14:51:54.691388 1 omap.go:87] got omap values: (pool="kube", namespace="", name="csi.volumes.default"): map[csi.volume.pvc-66d54022-c3eb-4f0f-aaec-96c1c863fa20:5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d] I0218 14:51:54.692038 1 omap.go:87] got omap values: (pool="kube", namespace="", name="csi.volume.5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d"): map[csi.imageid:37d98f9611da csi.imagename:csi-vol-5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d csi.volname:pvc-66d54022-c3eb-4f0f-aaec-96c1c863fa20 csi.volume.owner:default] I0218 14:51:54.692727 1 omap.go:87] got omap values: (pool="kube", namespace="", name="csi.volumes.default"): map[csi.volume.pvc-66d54022-c3eb-4f0f-aaec-96c1c863fa20:5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d] I0218 14:51:54.693253 1 omap.go:87] got omap values: (pool="kube", namespace="", name="csi.volume.5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d"): map[csi.imageid:37d98f9611da csi.imagename:csi-vol-5ce55702-0cd9-11f1-bd7b-eaa1bee61f6d csi.volname:pvc-66d54022-c3eb-4f0f-aaec-96c1c863fa20 csi.volume.owner:default] I0218 14:51:55.214701 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:57.230001 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:51:59.246527 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:01.263763 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:03.280355 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:05.299817 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:07.548769 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:09.565797 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:11.581675 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:13.596394 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system I0218 14:52:15.654981 1 leaderelection.go:278] successfully renewed lease kube-system/rbd.csi.ceph.com-kube-system E0218 14:52:27.657724 1 leaderelection.go:330] error retrieving resource lock kube-system/rbd.csi.ceph.com-kube-system: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/configmaps/rbd.csi.ceph.com-kube-system": context deadline exceeded I0218 14:52:27.658131 1 leaderelection.go:283] failed to renew lease kube-system/rbd.csi.ceph.com-kube-system: timed out waiting for the condition E0218 14:52:27.658270 1 controller.go:80] failed to start manager leader election lost E0218 14:52:27.658357 1 cephcsi.go:283] leader election lost