I0727 20:12:45.157084 1 feature_gate.go:245] feature gates: &{map[]} I0727 20:12:45.157140 1 csi-provisioner.go:139] Version: v3.1.0 I0727 20:12:45.157146 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0727 20:12:45.157692 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0727 20:12:55.158217 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0727 20:13:05.158183 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0727 20:13:06.411594 1 common.go:111] Probing CSI driver for readiness I0727 20:13:06.411619 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0727 20:13:06.411625 1 connection.go:184] GRPC request: {} I0727 20:13:06.416746 1 connection.go:186] GRPC response: {} I0727 20:13:06.416832 1 connection.go:187] GRPC error: I0727 20:13:06.416846 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0727 20:13:06.416855 1 connection.go:184] GRPC request: {} I0727 20:13:06.417542 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0727 20:13:06.417609 1 connection.go:187] GRPC error: I0727 20:13:06.417619 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0727 20:13:06.417626 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0727 20:13:06.417720 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0727 20:13:06.418646 1 common.go:111] Probing CSI driver for readiness I0727 20:13:06.418671 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0727 20:13:06.418679 1 connection.go:184] GRPC request: {} I0727 20:13:06.420083 1 connection.go:186] GRPC response: {} I0727 20:13:06.420428 1 connection.go:187] GRPC error: I0727 20:13:06.420635 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0727 20:13:06.420649 1 connection.go:184] GRPC request: {} I0727 20:13:06.422253 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0727 20:13:06.422467 1 connection.go:187] GRPC error: I0727 20:13:06.422480 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0727 20:13:06.422491 1 connection.go:184] GRPC request: {} I0727 20:13:06.423417 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0727 20:13:06.423547 1 connection.go:187] GRPC error: I0727 20:13:06.423618 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0727 20:13:06.424215 1 controller.go:732] Using saving PVs to API server in background I0727 20:13:06.424696 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0727 20:13:06.437248 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0727 20:13:06.437307 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-p8cw7 I0727 20:13:06.437333 1 leader_election.go:205] became leader, starting I0727 20:13:06.437555 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0727 20:13:06.437571 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0727 20:13:06.437970 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0727 20:13:06.437992 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0727 20:13:06.446655 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:06.537657 1 shared_informer.go:270] caches populated I0727 20:13:06.537748 1 shared_informer.go:270] caches populated I0727 20:13:06.537792 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-p8cw7_22b77767-c1f2-4f86-9bf2-2b00a3dcb2c6! I0727 20:13:06.537813 1 clone_controller.go:66] Starting CloningProtection controller I0727 20:13:06.537899 1 clone_controller.go:82] Started CloningProtection controller I0727 20:13:06.538053 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0727 20:13:06.538080 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0727 20:13:06.538203 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0727 20:13:06.538298 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0727 20:13:06.538502 1 volume_store.go:97] Starting save volume queue I0727 20:13:06.638468 1 shared_informer.go:270] caches populated I0727 20:13:06.639162 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-p8cw7_22b77767-c1f2-4f86-9bf2-2b00a3dcb2c6! I0727 20:13:11.456823 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:16.469639 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:21.477690 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:26.486087 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:31.494885 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:36.502720 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:41.510959 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:46.519444 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:51.528793 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:13:56.540448 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:01.548305 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:06.556876 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:11.565367 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:16.576134 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:21.584670 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:26.593138 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:31.603954 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:36.611659 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:41.621307 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:46.631225 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:51.639399 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:14:56.647051 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:01.655637 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:06.665232 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:11.673873 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:16.685976 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:21.694224 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:26.704912 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:31.714027 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:36.724808 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:41.734312 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:46.744864 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:51.755370 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:15:56.763111 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:01.771133 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:06.778827 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:11.790917 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:16.799857 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:21.808144 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:26.815949 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:31.823759 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:36.832264 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:41.841241 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:46.848742 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:51.856906 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:16:56.867676 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:01.876313 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:07.035440 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:12.044438 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:17.055028 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:20.458745 1 controller.go:1337] provision "default/test-pvc" class "general": started I0727 20:17:20.458845 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0727 20:17:20.459109 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"8c89a46d-6bae-4661-8ad8-3fc6ae4eba79", APIVersion:"v1", ResourceVersion:"2562", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0727 20:17:20.461602 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0727 20:17:20.461653 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0727 20:17:20.702415 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-2bcb6e74-89f8-11f1-980d-ae64bc154d9b","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-2bcb6e74-89f8-11f1-980d-ae64bc154d9b"}} I0727 20:17:20.702582 1 connection.go:187] GRPC error: I0727 20:17:20.702594 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-2bcb6e74-89f8-11f1-980d-ae64bc154d9b VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-2bcb6e74-89f8-11f1-980d-ae64bc154d9b journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0727 20:17:20.702645 1 controller.go:858] successfully created PV pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-2bcb6e74-89f8-11f1-980d-ae64bc154d9b I0727 20:17:20.702659 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-2bcb6e74-89f8-11f1-980d-ae64bc154d9b,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-2bcb6e74-89f8-11f1-980d-ae64bc154d9b,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1785183186423-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0727 20:17:20.702819 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79" provisioned I0727 20:17:20.702831 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0727 20:17:20.702837 1 volume_store.go:154] Saving volume pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 I0727 20:17:20.717512 1 volume_store.go:157] Volume pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 saved I0727 20:17:20.717606 1 controller.go:1069] Claim processing succeeded, removing PVC 8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 from claims in progress I0727 20:17:20.717811 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"8c89a46d-6bae-4661-8ad8-3fc6ae4eba79", APIVersion:"v1", ResourceVersion:"2562", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-8c89a46d-6bae-4661-8ad8-3fc6ae4eba79 I0727 20:17:22.064868 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:27.073912 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:32.081686 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:37.090103 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:42.100637 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:47.107972 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:52.114595 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:17:57.122331 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0727 20:18:02.130848 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com