I0408 00:38:18.236043 1 feature_gate.go:245] feature gates: &{map[]} I0408 00:38:18.236090 1 csi-provisioner.go:139] Version: v3.1.0 I0408 00:38:18.236093 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0408 00:38:18.236555 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0408 00:38:28.236704 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0408 00:38:38.237175 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0408 00:38:47.000794 1 common.go:111] Probing CSI driver for readiness I0408 00:38:47.000823 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0408 00:38:47.000830 1 connection.go:184] GRPC request: {} I0408 00:38:47.008756 1 connection.go:186] GRPC response: {} I0408 00:38:47.008852 1 connection.go:187] GRPC error: I0408 00:38:47.008865 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0408 00:38:47.008869 1 connection.go:184] GRPC request: {} I0408 00:38:47.009480 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0408 00:38:47.009541 1 connection.go:187] GRPC error: I0408 00:38:47.009553 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0408 00:38:47.009562 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0408 00:38:47.009657 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0408 00:38:47.010061 1 common.go:111] Probing CSI driver for readiness I0408 00:38:47.010071 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0408 00:38:47.010075 1 connection.go:184] GRPC request: {} I0408 00:38:47.010834 1 connection.go:186] GRPC response: {} I0408 00:38:47.010859 1 connection.go:187] GRPC error: I0408 00:38:47.010876 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0408 00:38:47.011040 1 connection.go:184] GRPC request: {} I0408 00:38:47.012167 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0408 00:38:47.012314 1 connection.go:187] GRPC error: I0408 00:38:47.012321 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0408 00:38:47.012325 1 connection.go:184] GRPC request: {} I0408 00:38:47.013284 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0408 00:38:47.013379 1 connection.go:187] GRPC error: I0408 00:38:47.013479 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0408 00:38:47.013964 1 controller.go:732] Using saving PVs to API server in background I0408 00:38:47.014381 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0408 00:38:47.030583 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0408 00:38:47.030738 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-7fjqd I0408 00:38:47.030870 1 leader_election.go:205] became leader, starting I0408 00:38:47.032704 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0408 00:38:47.032747 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0408 00:38:47.032793 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0408 00:38:47.032810 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0408 00:38:47.041574 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:38:47.131726 1 shared_informer.go:270] caches populated I0408 00:38:47.131807 1 shared_informer.go:270] caches populated I0408 00:38:47.131890 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-7fjqd_cc65774d-057e-4ac6-8650-0299c479cad2! I0408 00:38:47.132021 1 clone_controller.go:66] Starting CloningProtection controller I0408 00:38:47.132125 1 clone_controller.go:82] Started CloningProtection controller I0408 00:38:47.132349 1 volume_store.go:97] Starting save volume queue I0408 00:38:47.132390 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0408 00:38:47.132409 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0408 00:38:47.132445 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0408 00:38:47.132802 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0408 00:38:47.232329 1 shared_informer.go:270] caches populated I0408 00:38:47.233254 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-7fjqd_cc65774d-057e-4ac6-8650-0299c479cad2! I0408 00:38:52.101910 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:38:57.112656 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:02.123342 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:07.133239 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:12.142378 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:17.151867 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:22.184801 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:27.194447 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:32.203671 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:37.212106 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:42.220449 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:47.242411 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:52.250890 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:39:57.259619 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:02.267695 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:07.276726 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:12.285760 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:17.296097 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:22.350476 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:27.363039 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:32.374623 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:37.440610 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:42.449616 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:47.464352 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:52.473598 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:40:57.532076 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:02.538499 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:07.619926 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:12.629048 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:17.640298 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:22.650960 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:27.661424 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:32.669805 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:37.680816 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:42.688211 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:47.700352 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:51.096870 1 controller.go:1337] provision "default/test-pvc" class "general": started I0408 00:41:51.096983 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0408 00:41:51.097213 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"3f763ff1-f3f6-48d3-8a49-1c69df42e08d", APIVersion:"v1", ResourceVersion:"2244", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0408 00:41:51.100042 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0408 00:41:51.100074 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0408 00:41:52.301148 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-bb9410c3-32e3-11f1-b8af-ea39c508069d","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-bb9410c3-32e3-11f1-b8af-ea39c508069d"}} I0408 00:41:52.301332 1 connection.go:187] GRPC error: I0408 00:41:52.301346 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-bb9410c3-32e3-11f1-b8af-ea39c508069d VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-bb9410c3-32e3-11f1-b8af-ea39c508069d journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0408 00:41:52.301401 1 controller.go:858] successfully created PV pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-bb9410c3-32e3-11f1-b8af-ea39c508069d I0408 00:41:52.301422 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-bb9410c3-32e3-11f1-b8af-ea39c508069d,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-bb9410c3-32e3-11f1-b8af-ea39c508069d,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1775608727013-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0408 00:41:52.301653 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d" provisioned I0408 00:41:52.301667 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0408 00:41:52.301674 1 volume_store.go:154] Saving volume pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d I0408 00:41:52.309335 1 volume_store.go:157] Volume pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d saved I0408 00:41:52.309420 1 controller.go:1069] Claim processing succeeded, removing PVC 3f763ff1-f3f6-48d3-8a49-1c69df42e08d from claims in progress I0408 00:41:52.309629 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"3f763ff1-f3f6-48d3-8a49-1c69df42e08d", APIVersion:"v1", ResourceVersion:"2244", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-3f763ff1-f3f6-48d3-8a49-1c69df42e08d I0408 00:41:52.714059 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:41:57.722635 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:02.730729 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:07.737222 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:12.796038 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:17.805409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:22.814821 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:27.824221 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:32.831409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:37.838431 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0408 00:42:42.846904 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com