I0410 13:56:42.372550 1 feature_gate.go:245] feature gates: &{map[]} I0410 13:56:42.372608 1 csi-provisioner.go:139] Version: v3.1.0 I0410 13:56:42.372612 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0410 13:56:42.373035 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0410 13:56:52.374070 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0410 13:57:02.373514 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0410 13:57:03.695334 1 common.go:111] Probing CSI driver for readiness I0410 13:57:03.695374 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0410 13:57:03.695381 1 connection.go:184] GRPC request: {} I0410 13:57:03.707304 1 connection.go:186] GRPC response: {} I0410 13:57:03.707394 1 connection.go:187] GRPC error: I0410 13:57:03.707408 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0410 13:57:03.707413 1 connection.go:184] GRPC request: {} I0410 13:57:03.708385 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0410 13:57:03.708557 1 connection.go:187] GRPC error: I0410 13:57:03.708594 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0410 13:57:03.708628 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0410 13:57:03.708724 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0410 13:57:03.709474 1 common.go:111] Probing CSI driver for readiness I0410 13:57:03.709517 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0410 13:57:03.709573 1 connection.go:184] GRPC request: {} I0410 13:57:03.710242 1 connection.go:186] GRPC response: {} I0410 13:57:03.710303 1 connection.go:187] GRPC error: I0410 13:57:03.710329 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0410 13:57:03.710346 1 connection.go:184] GRPC request: {} I0410 13:57:03.711741 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0410 13:57:03.711925 1 connection.go:187] GRPC error: I0410 13:57:03.711949 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0410 13:57:03.711968 1 connection.go:184] GRPC request: {} I0410 13:57:03.712813 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0410 13:57:03.712963 1 connection.go:187] GRPC error: I0410 13:57:03.713024 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0410 13:57:03.713702 1 controller.go:732] Using saving PVs to API server in background I0410 13:57:03.714137 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0410 13:57:03.729422 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0410 13:57:03.729718 1 leader_election.go:205] became leader, starting I0410 13:57:03.729720 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-npzwj I0410 13:57:03.730066 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0410 13:57:03.730088 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0410 13:57:03.730358 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0410 13:57:03.730393 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0410 13:57:03.737837 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:03.830724 1 shared_informer.go:270] caches populated I0410 13:57:03.830837 1 shared_informer.go:270] caches populated I0410 13:57:03.830878 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-npzwj_6251fd1a-dcff-4416-97ca-a610a7e235ba! I0410 13:57:03.831009 1 clone_controller.go:66] Starting CloningProtection controller I0410 13:57:03.831074 1 clone_controller.go:82] Started CloningProtection controller I0410 13:57:03.831105 1 volume_store.go:97] Starting save volume queue I0410 13:57:03.831411 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0410 13:57:03.831434 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0410 13:57:03.834027 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0410 13:57:03.834079 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0410 13:57:03.931157 1 shared_informer.go:270] caches populated I0410 13:57:03.931607 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-npzwj_6251fd1a-dcff-4416-97ca-a610a7e235ba! I0410 13:57:08.747220 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:13.756354 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:18.767889 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:23.777660 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:28.791366 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:33.803813 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:38.812520 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:43.822482 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:48.831178 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:53.840762 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:57:58.849838 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:03.859299 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:08.880660 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:13.892156 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:18.903374 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:23.921340 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:28.931818 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:33.943538 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:38.951775 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:43.963793 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:48.972841 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:53.981134 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:58:58.993700 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:04.006171 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:09.018328 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:14.027894 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:19.037153 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:24.046708 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:29.058540 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:34.068793 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:39.078869 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:44.092846 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:49.100771 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:54.110749 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 13:59:59.123812 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:04.137690 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:09.146997 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:14.156629 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:15.546593 1 controller.go:1337] provision "default/test-pvc" class "general": started I0410 14:00:15.546678 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0410 14:00:15.547045 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"0c26af97-075b-4ddc-b281-5f4ca93dccfd", APIVersion:"v1", ResourceVersion:"2278", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0410 14:00:15.552594 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0410 14:00:15.552617 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0410 14:00:17.221258 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-99af8825-34e5-11f1-994a-6696a5525bf3","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-99af8825-34e5-11f1-994a-6696a5525bf3"}} I0410 14:00:17.221453 1 connection.go:187] GRPC error: I0410 14:00:17.221466 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-99af8825-34e5-11f1-994a-6696a5525bf3 VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-99af8825-34e5-11f1-994a-6696a5525bf3 journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0410 14:00:17.221709 1 controller.go:858] successfully created PV pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-99af8825-34e5-11f1-994a-6696a5525bf3 I0410 14:00:17.221732 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-99af8825-34e5-11f1-994a-6696a5525bf3,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-99af8825-34e5-11f1-994a-6696a5525bf3,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1775829423712-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0410 14:00:17.222048 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd" provisioned I0410 14:00:17.222078 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0410 14:00:17.222086 1 volume_store.go:154] Saving volume pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd I0410 14:00:17.232939 1 volume_store.go:157] Volume pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd saved I0410 14:00:17.232981 1 controller.go:1069] Claim processing succeeded, removing PVC 0c26af97-075b-4ddc-b281-5f4ca93dccfd from claims in progress I0410 14:00:17.233003 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"0c26af97-075b-4ddc-b281-5f4ca93dccfd", APIVersion:"v1", ResourceVersion:"2278", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-0c26af97-075b-4ddc-b281-5f4ca93dccfd I0410 14:00:19.165453 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:24.176591 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:29.185831 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:34.194973 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:39.203694 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:44.210361 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:49.218260 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:54.228099 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:00:59.252741 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:01:04.260325 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0410 14:01:09.271783 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com