=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:526: csi-hostpath-driver pods stabilized in 11.326687ms

addons_test.go:529: (dbg) Run:  kubectl --context addons-20210813200824-393438 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:534: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210813200824-393438 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210813200824-393438 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:539: (dbg) Run:  kubectl --context addons-20210813200824-393438 create -f testdata/csi-hostpath-driver/pv-pod.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:544: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:343: "task-pv-pod" [ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e] Pending

helpers_test.go:343: "task-pv-pod" [ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

addons_test.go:544: ***** TestAddons/parallel/CSI: pod "app=task-pv-pod" failed to start within 6m0s: timed out waiting for the condition ****

addons_test.go:544: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-20210813200824-393438 -n addons-20210813200824-393438

addons_test.go:544: TestAddons/parallel/CSI: showing logs for failed pods as of 2021-08-13 20:18:04.629294177 +0000 UTC m=+613.648332244

addons_test.go:544: (dbg) Run:  kubectl --context addons-20210813200824-393438 describe po task-pv-pod -n default

addons_test.go:544: (dbg) kubectl --context addons-20210813200824-393438 describe po task-pv-pod -n default:

Name:         task-pv-pod

Namespace:    default

Priority:     0

Node:         addons-20210813200824-393438/192.168.39.71

Start Time:   Fri, 13 Aug 2021 20:12:04 +0000

Labels:       app=task-pv-pod

Annotations:  <none>

Status:       Pending

IP:           

IPs:          <none>

Containers:

task-pv-container:

Container ID:   

Image:          nginx

Image ID:       

Port:           80/TCP

Host Port:      0/TCP

State:          Waiting

Reason:       ContainerCreating

Ready:          False

Restart Count:  0

Environment:

GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

PROJECT_ID:                      k8s-minikube

GCP_PROJECT:                     k8s-minikube

GCLOUD_PROJECT:                  k8s-minikube

GOOGLE_CLOUD_PROJECT:            k8s-minikube

CLOUDSDK_CORE_PROJECT:           k8s-minikube

Mounts:

/google-app-creds.json from gcp-creds (ro)

/usr/share/nginx/html from task-pv-storage (rw)

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-945zl (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

task-pv-storage:

Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

ClaimName:  hpvc

ReadOnly:   false

kube-api-access-945zl:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

gcp-creds:

Type:          HostPath (bare host directory volume)

Path:          /var/lib/minikube/google_application_credentials.json

HostPathType:  File

QoS Class:         BestEffort

Node-Selectors:    <none>

Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason                   Age                  From                                      Message

----     ------                   ----                 ----                                      -------

Normal   Scheduled                6m                   default-scheduler                         Successfully assigned default/task-pv-pod to addons-20210813200824-393438

Normal   SuccessfulAttachVolume   6m                   attachdetach-controller                   AttachVolume.Attach succeeded for volume "pvc-6bc352b4-44e1-415a-a380-b3e5e2507bd9"

Warning  VolumeConditionAbnormal  5m59s (x10 over 6m)  csi-pv-monitor-agent-hostpath.csi.k8s.io  The volume isn't mounted

Warning  FailedMount              3m57s                kubelet                                   Unable to attach or mount volumes: unmounted volumes=[gcp-creds], unattached volumes=[kube-api-access-945zl gcp-creds task-pv-storage]: timed out waiting for the condition

Warning  FailedMount              110s (x10 over 6m)   kubelet                                   MountVolume.SetUp failed for volume "gcp-creds" : hostPath type check failed: /var/lib/minikube/google_application_credentials.json is not a file

Warning  FailedMount              100s                 kubelet                                   Unable to attach or mount volumes: unmounted volumes=[gcp-creds], unattached volumes=[task-pv-storage kube-api-access-945zl gcp-creds]: timed out waiting for the condition

Normal   VolumeConditionNormal    60s (x41 over 5m)    csi-pv-monitor-agent-hostpath.csi.k8s.io  The Volume returns to the healthy state

addons_test.go:544: (dbg) Run:  kubectl --context addons-20210813200824-393438 logs task-pv-pod -n default

addons_test.go:544: (dbg) Non-zero exit: kubectl --context addons-20210813200824-393438 logs task-pv-pod -n default: exit status 1 (82.166709ms)

** stderr ** 

	Error from server (BadRequest): container "task-pv-container" in pod "task-pv-pod" is waiting to start: ContainerCreating

** /stderr **

addons_test.go:544: kubectl --context addons-20210813200824-393438 logs task-pv-pod -n default: exit status 1

addons_test.go:545: failed waiting for pod task-pv-pod: app=task-pv-pod within 6m0s: timed out waiting for the condition

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p addons-20210813200824-393438 -n addons-20210813200824-393438

helpers_test.go:245: <<< TestAddons/parallel/CSI FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestAddons/parallel/CSI]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210813200824-393438 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p addons-20210813200824-393438 logs -n 25: (1.387485067s)

helpers_test.go:253: TestAddons/parallel/CSI logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-------------------------------------|-------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                Args                 |               Profile               |  User   | Version |          Start Time           |           End Time            |

	|---------|-------------------------------------|-------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | --all                               | download-only-20210813200751-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:08:24 UTC | Fri, 13 Aug 2021 20:08:24 UTC |

	| delete  | -p                                  | download-only-20210813200751-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:08:24 UTC | Fri, 13 Aug 2021 20:08:24 UTC |

	|         | download-only-20210813200751-393438 |                                     |         |         |                               |                               |

	| delete  | -p                                  | download-only-20210813200751-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:08:24 UTC | Fri, 13 Aug 2021 20:08:24 UTC |

	|         | download-only-20210813200751-393438 |                                     |         |         |                               |                               |

	| start   | -p                                  | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:08:24 UTC | Fri, 13 Aug 2021 20:11:02 UTC |

	|         | addons-20210813200824-393438        |                                     |         |         |                               |                               |

	|         | --wait=true --memory=4000           |                                     |         |         |                               |                               |

	|         | --alsologtostderr                   |                                     |         |         |                               |                               |

	|         | --addons=registry                   |                                     |         |         |                               |                               |

	|         | --addons=metrics-server             |                                     |         |         |                               |                               |

	|         | --addons=olm                        |                                     |         |         |                               |                               |

	|         | --addons=volumesnapshots            |                                     |         |         |                               |                               |

	|         | --addons=csi-hostpath-driver        |                                     |         |         |                               |                               |

	|         | --driver=kvm2                       |                                     |         |         |                               |                               |

	|         | --container-runtime=containerd      |                                     |         |         |                               |                               |

	|         | --addons=ingress                    |                                     |         |         |                               |                               |

	|         | --addons=helm-tiller                |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:16 UTC | Fri, 13 Aug 2021 20:11:29 UTC |

	|         | addons enable gcp-auth --force      |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:34 UTC | Fri, 13 Aug 2021 20:11:35 UTC |

	|         | addons disable metrics-server       |                                     |         |         |                               |                               |

	|         | --alsologtostderr -v=1              |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:46 UTC | Fri, 13 Aug 2021 20:11:46 UTC |

	|         | ssh curl -s http://127.0.0.1/       |                                     |         |         |                               |                               |

	|         | -H 'Host: nginx.example.com'        |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:47 UTC | Fri, 13 Aug 2021 20:11:47 UTC |

	|         | ssh curl -s http://127.0.0.1/       |                                     |         |         |                               |                               |

	|         | -H 'Host: nginx.example.com'        |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:49 UTC | Fri, 13 Aug 2021 20:11:49 UTC |

	|         | ip                                  |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:49 UTC | Fri, 13 Aug 2021 20:11:50 UTC |

	|         | addons disable registry             |                                     |         |         |                               |                               |

	|         | --alsologtostderr -v=1              |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:12:01 UTC | Fri, 13 Aug 2021 20:12:02 UTC |

	|         | addons disable helm-tiller          |                                     |         |         |                               |                               |

	|         | --alsologtostderr -v=1              |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:12:04 UTC | Fri, 13 Aug 2021 20:12:15 UTC |

	|         | addons disable gcp-auth             |                                     |         |         |                               |                               |

	|         | --alsologtostderr -v=1              |                                     |         |         |                               |                               |

	| -p      | addons-20210813200824-393438        | addons-20210813200824-393438        | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:11:47 UTC | Fri, 13 Aug 2021 20:12:17 UTC |

	|         | addons disable ingress              |                                     |         |         |                               |                               |

	|         | --alsologtostderr -v=1              |                                     |         |         |                               |                               |

	|---------|-------------------------------------|-------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:08:24

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:08:24.800545  393795 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:08:24.800618  393795 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:08:24.800622  393795 out.go:311] Setting ErrFile to fd 2...

	I0813 20:08:24.800625  393795 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:08:24.800718  393795 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:08:24.800987  393795 out.go:305] Setting JSON to false

	I0813 20:08:24.834776  393795 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":3067,"bootTime":1628882238,"procs":136,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:08:24.834895  393795 start.go:121] virtualization: kvm guest

	I0813 20:08:24.837272  393795 out.go:177] * [addons-20210813200824-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:08:24.838705  393795 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:08:24.837395  393795 notify.go:169] Checking for updates...

	I0813 20:08:24.840040  393795 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:08:24.841315  393795 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:08:24.842520  393795 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:08:24.842688  393795 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:08:24.870001  393795 out.go:177] * Using the kvm2 driver based on user configuration

	I0813 20:08:24.870023  393795 start.go:278] selected driver: kvm2

	I0813 20:08:24.870028  393795 start.go:751] validating driver "kvm2" against <nil>

	I0813 20:08:24.870043  393795 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:08:24.870995  393795 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:08:24.871142  393795 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:08:24.881649  393795 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:08:24.881689  393795 start_flags.go:263] no existing cluster config was found, will generate one from the flags 

	I0813 20:08:24.881819  393795 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 20:08:24.881839  393795 cni.go:93] Creating CNI manager for ""

	I0813 20:08:24.881845  393795 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:08:24.881850  393795 start_flags.go:272] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0813 20:08:24.881859  393795 start_flags.go:277] config:

	{Name:addons-20210813200824-393438 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:addons-20210813200824-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunt

ime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:08:24.881969  393795 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:08:24.883708  393795 out.go:177] * Starting control plane node addons-20210813200824-393438 in cluster addons-20210813200824-393438

	I0813 20:08:24.883727  393795 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:08:24.883750  393795 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4

	I0813 20:08:24.883776  393795 cache.go:56] Caching tarball of preloaded images

	I0813 20:08:24.883886  393795 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:08:24.883901  393795 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on containerd

	I0813 20:08:24.884151  393795 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/config.json ...

	I0813 20:08:24.884171  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/config.json: {Name:mkb230a820100d96b12ecd4d934e4b554ec0077b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:08:24.884283  393795 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:08:24.884307  393795 start.go:313] acquiring machines lock for addons-20210813200824-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:08:24.884366  393795 start.go:317] acquired machines lock for "addons-20210813200824-393438" in 47.229µs

	I0813 20:08:24.884384  393795 start.go:89] Provisioning new machine with config: &{Name:addons-20210813200824-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.21.3 ClusterName:addons-20210813200824-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 20:08:24.884430  393795 start.go:126] createHost starting for "" (driver="kvm2")

	I0813 20:08:24.886101  393795 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0813 20:08:24.886199  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:08:24.886266  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:08:24.895639  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:45471

	I0813 20:08:24.896024  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:08:24.896520  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:08:24.896543  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:08:24.896919  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:08:24.897106  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetMachineName

	I0813 20:08:24.897243  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:24.897388  393795 start.go:160] libmachine.API.Create for "addons-20210813200824-393438" (driver="kvm2")

	I0813 20:08:24.897413  393795 client.go:168] LocalClient.Create starting

	I0813 20:08:24.897441  393795 main.go:130] libmachine: Creating CA: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem

	I0813 20:08:25.120617  393795 main.go:130] libmachine: Creating client certificate: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem

	I0813 20:08:25.280845  393795 main.go:130] libmachine: Running pre-create checks...

	I0813 20:08:25.280870  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .PreCreateCheck

	I0813 20:08:25.281275  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetConfigRaw

	I0813 20:08:25.281798  393795 main.go:130] libmachine: Creating machine...

	I0813 20:08:25.281814  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Create

	I0813 20:08:25.281948  393795 main.go:130] libmachine: (addons-20210813200824-393438) Creating KVM machine...

	I0813 20:08:25.284504  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found existing default KVM network

	I0813 20:08:25.285421  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.285273  393819 network.go:288] reserving subnet 192.168.39.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.39.0:0xc0000a85c8] misses:0}

	I0813 20:08:25.285456  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.285374  393819 network.go:235] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0813 20:08:25.309231  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | trying to create private KVM network mk-addons-20210813200824-393438 192.168.39.0/24...

	I0813 20:08:25.523327  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | private KVM network mk-addons-20210813200824-393438 192.168.39.0/24 created

	I0813 20:08:25.523364  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.523289  393819 common.go:108] Making disk image using store path: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:08:25.523388  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting up store path in /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438 ...

	I0813 20:08:25.523416  393795 main.go:130] libmachine: (addons-20210813200824-393438) Building disk image from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso

	I0813 20:08:25.523518  393795 main.go:130] libmachine: (addons-20210813200824-393438) Downloading /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso...

	I0813 20:08:25.708900  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.708765  393819 common.go:115] Creating ssh key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa...

	I0813 20:08:25.773951  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.773861  393819 common.go:121] Creating raw disk image: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/addons-20210813200824-393438.rawdisk...

	I0813 20:08:25.773977  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Writing magic tar header

	I0813 20:08:25.773999  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Writing SSH key tar header

	I0813 20:08:25.774021  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:25.773973  393819 common.go:135] Fixing permissions on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438 ...

	I0813 20:08:25.774191  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438

	I0813 20:08:25.774234  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438 (perms=drwx------)

	I0813 20:08:25.774257  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines

	I0813 20:08:25.774294  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:08:25.774306  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337

	I0813 20:08:25.774322  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines (perms=drwxr-xr-x)

	I0813 20:08:25.774337  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0813 20:08:25.774357  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home/jenkins

	I0813 20:08:25.774368  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Checking permissions on dir: /home

	I0813 20:08:25.774385  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube (perms=drwxr-xr-x)

	I0813 20:08:25.774401  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Skipping /home - not owner

	I0813 20:08:25.774448  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337 (perms=drwxr-xr-x)

	I0813 20:08:25.774483  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxr-xr-x)

	I0813 20:08:25.774500  393795 main.go:130] libmachine: (addons-20210813200824-393438) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0813 20:08:25.774514  393795 main.go:130] libmachine: (addons-20210813200824-393438) Creating domain...

	I0813 20:08:25.798328  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:25:a3:63 in network default

	I0813 20:08:25.798839  393795 main.go:130] libmachine: (addons-20210813200824-393438) Ensuring networks are active...

	I0813 20:08:25.798864  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:25.800465  393795 main.go:130] libmachine: (addons-20210813200824-393438) Ensuring network default is active

	I0813 20:08:25.800700  393795 main.go:130] libmachine: (addons-20210813200824-393438) Ensuring network mk-addons-20210813200824-393438 is active

	I0813 20:08:25.801202  393795 main.go:130] libmachine: (addons-20210813200824-393438) Getting domain xml...

	I0813 20:08:25.802844  393795 main.go:130] libmachine: (addons-20210813200824-393438) Creating domain...

	I0813 20:08:26.299858  393795 main.go:130] libmachine: (addons-20210813200824-393438) Waiting to get IP...

	I0813 20:08:26.300602  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:26.300906  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:26.300956  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:26.300902  393819 retry.go:31] will retry after 263.082536ms: waiting for machine to come up

	I0813 20:08:26.565182  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:26.565500  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:26.565525  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:26.565454  393819 retry.go:31] will retry after 381.329545ms: waiting for machine to come up

	I0813 20:08:26.947958  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:26.948312  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:26.948343  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:26.948256  393819 retry.go:31] will retry after 422.765636ms: waiting for machine to come up

	I0813 20:08:27.372761  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:27.373105  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:27.373142  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:27.373034  393819 retry.go:31] will retry after 473.074753ms: waiting for machine to come up

	I0813 20:08:27.847536  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:27.847872  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:27.847902  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:27.847817  393819 retry.go:31] will retry after 587.352751ms: waiting for machine to come up

	I0813 20:08:28.436185  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:28.436478  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:28.436502  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:28.436442  393819 retry.go:31] will retry after 834.206799ms: waiting for machine to come up

	I0813 20:08:29.272247  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:29.272541  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:29.272575  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:29.272483  393819 retry.go:31] will retry after 746.553905ms: waiting for machine to come up

	I0813 20:08:30.020819  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:31.892510  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:31.892562  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:30.021036  393819 retry.go:31] will retry after 987.362415ms: waiting for machine to come up

	I0813 20:08:31.892579  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:31.892589  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:31.892600  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:31.010439  393819 retry.go:31] will retry after 1.189835008s: waiting for machine to come up

	I0813 20:08:32.201692  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:32.202033  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:32.202075  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:32.201951  393819 retry.go:31] will retry after 1.677229867s: waiting for machine to come up

	I0813 20:08:33.880215  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:33.880538  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:33.880569  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:33.880499  393819 retry.go:31] will retry after 2.346016261s: waiting for machine to come up

	I0813 20:08:36.228523  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:40.763772  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:40.763820  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:36.228797  393819 retry.go:31] will retry after 3.36678925s: waiting for machine to come up

	I0813 20:08:40.763838  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:40.763850  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find current IP address of domain addons-20210813200824-393438 in network mk-addons-20210813200824-393438

	I0813 20:08:40.763858  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | I0813 20:08:39.599354  393819 retry.go:31] will retry after 3.11822781s: waiting for machine to come up

	I0813 20:08:42.720826  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.721189  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has current primary IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.721222  393795 main.go:130] libmachine: (addons-20210813200824-393438) Found IP for machine: 192.168.39.71

	I0813 20:08:42.721238  393795 main.go:130] libmachine: (addons-20210813200824-393438) Reserving static IP address...

	I0813 20:08:42.721527  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | unable to find host DHCP lease matching {name: "addons-20210813200824-393438", mac: "52:54:00:1a:a8:f0", ip: "192.168.39.71"} in network mk-addons-20210813200824-393438

	I0813 20:08:42.766188  393795 main.go:130] libmachine: (addons-20210813200824-393438) Reserved static IP address: 192.168.39.71

	I0813 20:08:42.766225  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Getting to WaitForSSH function...

	I0813 20:08:42.766236  393795 main.go:130] libmachine: (addons-20210813200824-393438) Waiting for SSH to be available...

	I0813 20:08:42.770742  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.771100  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:42.771131  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.771238  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Using SSH client type: external

	I0813 20:08:42.771266  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Using SSH private key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa (-rw-------)

	I0813 20:08:42.771310  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.71 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0813 20:08:42.771331  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | About to run SSH command:

	I0813 20:08:42.771344  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | exit 0

	I0813 20:08:42.905708  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | SSH cmd err, output: <nil>: 

	I0813 20:08:42.906070  393795 main.go:130] libmachine: (addons-20210813200824-393438) KVM machine creation complete!

	I0813 20:08:42.906139  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetConfigRaw

	I0813 20:08:42.906751  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:42.906958  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:42.907115  393795 main.go:130] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0813 20:08:42.907137  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:08:42.909531  393795 main.go:130] libmachine: Detecting operating system of created instance...

	I0813 20:08:42.909544  393795 main.go:130] libmachine: Waiting for SSH to be available...

	I0813 20:08:42.909551  393795 main.go:130] libmachine: Getting to WaitForSSH function...

	I0813 20:08:42.909558  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:42.913824  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.914100  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:42.914129  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:42.914206  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:42.914436  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:42.914577  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:42.914735  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:42.914875  393795 main.go:130] libmachine: Using SSH client type: native

	I0813 20:08:42.915070  393795 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.71 22 <nil> <nil>}

	I0813 20:08:42.915081  393795 main.go:130] libmachine: About to run SSH command:

	exit 0

	I0813 20:08:43.029551  393795 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:08:43.029574  393795 main.go:130] libmachine: Detecting the provisioner...

	I0813 20:08:43.029581  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.034336  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.034613  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.034640  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.034770  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.034918  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.035032  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.035147  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.035306  393795 main.go:130] libmachine: Using SSH client type: native

	I0813 20:08:43.035470  393795 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.71 22 <nil> <nil>}

	I0813 20:08:43.035482  393795 main.go:130] libmachine: About to run SSH command:

	cat /etc/os-release

	I0813 20:08:43.154932  393795 main.go:130] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2020.02.12

	ID=buildroot

	VERSION_ID=2020.02.12

	PRETTY_NAME="Buildroot 2020.02.12"

	I0813 20:08:43.155054  393795 main.go:130] libmachine: found compatible host: buildroot

	I0813 20:08:43.155068  393795 main.go:130] libmachine: Provisioning with buildroot...

	I0813 20:08:43.155076  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetMachineName

	I0813 20:08:43.155288  393795 buildroot.go:166] provisioning hostname "addons-20210813200824-393438"

	I0813 20:08:43.155312  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetMachineName

	I0813 20:08:43.155454  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.160248  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.160525  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.160554  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.160615  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.160767  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.160890  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.161014  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.161208  393795 main.go:130] libmachine: Using SSH client type: native

	I0813 20:08:43.161360  393795 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.71 22 <nil> <nil>}

	I0813 20:08:43.161378  393795 main.go:130] libmachine: About to run SSH command:

	sudo hostname addons-20210813200824-393438 && echo "addons-20210813200824-393438" | sudo tee /etc/hostname

	I0813 20:08:43.286438  393795 main.go:130] libmachine: SSH cmd err, output: <nil>: addons-20210813200824-393438

	I0813 20:08:43.286470  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.291714  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.292060  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.292089  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.292267  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.292449  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.292613  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.292778  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.292969  393795 main.go:130] libmachine: Using SSH client type: native

	I0813 20:08:43.293123  393795 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.71 22 <nil> <nil>}

	I0813 20:08:43.293153  393795 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-20210813200824-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-20210813200824-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-20210813200824-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:08:43.416973  393795 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:08:43.416997  393795 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:08:43.417017  393795 buildroot.go:174] setting up certificates

	I0813 20:08:43.417030  393795 provision.go:83] configureAuth start

	I0813 20:08:43.417049  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetMachineName

	I0813 20:08:43.417253  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetIP

	I0813 20:08:43.421873  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.422220  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.422260  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.422321  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.426540  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.426839  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.426868  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.426944  393795 provision.go:138] copyHostCerts

	I0813 20:08:43.427010  393795 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:08:43.427140  393795 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:08:43.427199  393795 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:08:43.427247  393795 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.addons-20210813200824-393438 san=[192.168.39.71 192.168.39.71 localhost 127.0.0.1 minikube addons-20210813200824-393438]

	I0813 20:08:43.554559  393795 provision.go:172] copyRemoteCerts

	I0813 20:08:43.554610  393795 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:08:43.554635  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.559056  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.559317  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.559350  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.559455  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.559600  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.559737  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.559830  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:08:43.645777  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)

	I0813 20:08:43.661302  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 20:08:43.676456  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:08:43.692999  393795 provision.go:86] duration metric: configureAuth took 275.952288ms

	I0813 20:08:43.693018  393795 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:08:43.693172  393795 config.go:177] Loaded profile config "addons-20210813200824-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:08:43.693196  393795 main.go:130] libmachine: Checking connection to Docker...

	I0813 20:08:43.693211  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetURL

	I0813 20:08:43.696318  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Using libvirt version 3000000

	I0813 20:08:43.700398  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.700674  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.700703  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.700831  393795 main.go:130] libmachine: Docker is up and running!

	I0813 20:08:43.700844  393795 main.go:130] libmachine: Reticulating splines...

	I0813 20:08:43.700851  393795 client.go:171] LocalClient.Create took 18.803432411s

	I0813 20:08:43.700868  393795 start.go:168] duration metric: libmachine.API.Create for "addons-20210813200824-393438" took 18.803481306s

	I0813 20:08:43.700883  393795 start.go:267] post-start starting for "addons-20210813200824-393438" (driver="kvm2")

	I0813 20:08:43.700889  393795 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:08:43.700910  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:43.701094  393795 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:08:43.701118  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.704953  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.705205  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.705240  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.705355  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.705534  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.705666  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.705761  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:08:43.789685  393795 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:08:43.794102  393795 info.go:137] Remote host: Buildroot 2020.02.12

	I0813 20:08:43.794122  393795 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:08:43.794186  393795 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:08:43.794223  393795 start.go:270] post-start completed in 93.333859ms

	I0813 20:08:43.794254  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetConfigRaw

	I0813 20:08:43.794756  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetIP

	I0813 20:08:43.799159  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.799440  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.799466  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.799674  393795 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/config.json ...

	I0813 20:08:43.799818  393795 start.go:129] duration metric: createHost completed in 18.915380594s

	I0813 20:08:43.799829  393795 start.go:80] releasing machines lock for "addons-20210813200824-393438", held for 18.915453659s

	I0813 20:08:43.799863  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:43.800043  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetIP

	I0813 20:08:43.804111  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.804351  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.804376  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.804493  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:43.804646  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:43.805041  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:08:43.805267  393795 ssh_runner.go:149] Run: systemctl --version

	I0813 20:08:43.805289  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.805312  393795 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:08:43.805344  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:08:43.811696  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.811832  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.812045  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.812073  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.812099  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:08:43.812120  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:08:43.812192  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.812393  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:08:43.812403  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.812554  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.812566  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:08:43.812725  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:08:43.812720  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:08:43.812837  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:08:43.895987  393795 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:08:43.896071  393795 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:08:47.906062  393795 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.009958464s)

	I0813 20:08:47.906190  393795 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.21.3". assuming images are not preloaded.

	I0813 20:08:47.906258  393795 ssh_runner.go:149] Run: which lz4

	I0813 20:08:47.910455  393795 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:08:47.914934  393795 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:08:47.914966  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (928970367 bytes)

	I0813 20:08:51.785606  393795 containerd.go:546] Took 3.875185 seconds to copy over tarball

	I0813 20:08:51.785683  393795 ssh_runner.go:149] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0813 20:08:59.266406  393795 ssh_runner.go:189] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (7.480697941s)

	I0813 20:08:59.266440  393795 containerd.go:553] Took 7.480799 seconds t extract the tarball

	I0813 20:08:59.266451  393795 ssh_runner.go:100] rm: /preloaded.tar.lz4

	I0813 20:08:59.331752  393795 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:08:59.501887  393795 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:08:59.552920  393795 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:08:59.589032  393795 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:08:59.603064  393795 docker.go:153] disabling docker service ...

	I0813 20:08:59.603123  393795 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:08:59.613338  393795 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:08:59.624260  393795 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:08:59.756397  393795 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:09:00.324502  393795 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:09:00.334994  393795 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:09:00.348430  393795 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuNC4xIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKCglbcGx1Z2lucy4iaW8uY

29udGFpbmVyZC5ncnBjLnYxLmNyaSJdCiAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzXQogICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuY10KICAgICAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuYy5vcHRpb25zXQogICAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkXQogICAgICBzbmFwc2hvdHRlciA9ICJvdmVybGF5ZnMiCiAgICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkLmRlZmF1bHRfcnVudGltZV0KICAgICAgICBydW50aW1lX3R5cGUgPSAiaW8uY29udGFpbmVyZC5ydW5jLnYyIgogICAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZC51bnRydXN0ZWRfd29ya2xvYWRfcnVudGltZV0KICAgICAgICBydW50aW1lX3R5cGUgPSAiIgogICAgICAgIHJ1bnRpbWVfZW5naW5lID0gIiIKICAgICAgICBydW50aW1lX3Jvb3QgPSAiIgogICAgW3BsdWdpbnMuY3JpLmNuaV0KICAgICAgYmluX2RpciA9ICIvb3B0L2NuaS9iaW4iCiAgICAgIGNvbmZfZGlyID0gIi9ldGMvY25pL25ldC5kI

gogICAgICBjb25mX3RlbXBsYXRlID0gIiIKICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeV0KICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnNdCiAgICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnMuImRvY2tlci5pbyJdCiAgICAgICAgICBlbmRwb2ludCA9IFsiaHR0cHM6Ly9yZWdpc3RyeS0xLmRvY2tlci5pbyJdCiAgICAgICAgW3BsdWdpbnMuZGlmZi1zZXJ2aWNlXQogICAgZGVmYXVsdCA9IFsid2Fsa2luZyJdCiAgW3BsdWdpbnMuc2NoZWR1bGVyXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:09:00.361639  393795 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:09:00.368531  393795 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0813 20:09:00.368595  393795 ssh_runner.go:149] Run: sudo modprobe br_netfilter

	I0813 20:09:00.385237  393795 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:09:00.391592  393795 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:09:00.519828  393795 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:09:03.676080  393795 ssh_runner.go:189] Completed: sudo systemctl restart containerd: (3.156204056s)

	I0813 20:09:03.676120  393795 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:09:03.676184  393795 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:09:03.689613  393795 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:09:04.795228  393795 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:09:04.800738  393795 start.go:413] Will wait 60s for crictl version

	I0813 20:09:04.800797  393795 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:09:04.838265  393795 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.9

	RuntimeApiVersion:  v1alpha2

	I0813 20:09:04.838331  393795 ssh_runner.go:149] Run: containerd --version

	I0813 20:09:04.867615  393795 ssh_runner.go:149] Run: containerd --version

	I0813 20:09:04.901993  393795 out.go:177] * Preparing Kubernetes v1.21.3 on containerd 1.4.9 ...

	I0813 20:09:04.902037  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetIP

	I0813 20:09:04.907966  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:04.908358  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:04.908388  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:04.908603  393795 ssh_runner.go:149] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0813 20:09:04.915209  393795 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:09:04.927150  393795 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:09:04.927218  393795 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:09:04.961677  393795 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:09:04.961698  393795 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:09:04.961739  393795 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:09:04.991402  393795 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:09:04.991421  393795 cache_images.go:74] Images are preloaded, skipping loading

	I0813 20:09:04.991465  393795 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:09:05.026530  393795 cni.go:93] Creating CNI manager for ""

	I0813 20:09:05.026549  393795 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:09:05.026573  393795 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:09:05.026589  393795 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.71 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-20210813200824-393438 NodeName:addons-20210813200824-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.71"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.39.71 CgroupDriver:cgroupfs ClientCAFi

le:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:09:05.026794  393795 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.71

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "addons-20210813200824-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.71

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.71"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:09:05.026914  393795 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=addons-20210813200824-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.71 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:addons-20210813200824-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:09:05.026970  393795 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 20:09:05.034281  393795 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:09:05.034329  393795 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:09:05.041235  393795 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (543 bytes)

	I0813 20:09:05.053001  393795 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:09:05.064464  393795 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2081 bytes)

	I0813 20:09:05.075905  393795 ssh_runner.go:149] Run: grep 192.168.39.71	control-plane.minikube.internal$ /etc/hosts

	I0813 20:09:05.079850  393795 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.71	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:09:05.089799  393795 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438 for IP: 192.168.39.71

	I0813 20:09:05.089840  393795 certs.go:183] generating minikubeCA CA: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:09:05.363891  393795 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt ...

	I0813 20:09:05.363919  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt: {Name:mk96a7b146aed67a7ddc77414e0d7ee4a9f5639f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.364160  393795 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key ...

	I0813 20:09:05.364177  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key: {Name:mkb28d534ae8896c3c63f31184e051442e741d84 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.364293  393795 certs.go:183] generating proxyClientCA CA: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:09:05.585285  393795 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt ...

	I0813 20:09:05.585315  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt: {Name:mk0af008d0762eedd86b6f4bf2a05829d95a7dbb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.585500  393795 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key ...

	I0813 20:09:05.585517  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key: {Name:mk496073d6e9326b9534a852520dd9a1dfacd8da Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.585655  393795 certs.go:297] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.key

	I0813 20:09:05.585667  393795 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.crt with IP's: []

	I0813 20:09:05.676108  393795 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.crt ...

	I0813 20:09:05.676136  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.crt: {Name:mkc7e44aa5bb20ac3af4a16850ce3ec836415891 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.676305  393795 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.key ...

	I0813 20:09:05.676321  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/client.key: {Name:mk61203d37cf0ac863f5f6a423df792d7e1ea9e5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.676433  393795 certs.go:297] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key.f4667c0f

	I0813 20:09:05.676444  393795 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt.f4667c0f with IP's: [192.168.39.71 10.96.0.1 127.0.0.1 10.0.0.1]

	I0813 20:09:05.807372  393795 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt.f4667c0f ...

	I0813 20:09:05.807398  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt.f4667c0f: {Name:mkd336c86f26f549d9c200ce36597a89bb6da139 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.807541  393795 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key.f4667c0f ...

	I0813 20:09:05.807555  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key.f4667c0f: {Name:mkf07a59d7356cf2645516afc5686e9070652037 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:05.807647  393795 certs.go:308] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt.f4667c0f -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt

	I0813 20:09:05.807719  393795 certs.go:312] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key.f4667c0f -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key

	I0813 20:09:05.807787  393795 certs.go:297] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.key

	I0813 20:09:05.807799  393795 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.crt with IP's: []

	I0813 20:09:06.096866  393795 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.crt ...

	I0813 20:09:06.096908  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.crt: {Name:mkfd8392816cb47f48c4f770332fffb25ddf747f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:06.097125  393795 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.key ...

	I0813 20:09:06.097144  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.key: {Name:mk7c69f37f8cb4970c5fc7ce2777f2c2bae2ecca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:06.097357  393795 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:09:06.097403  393795 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:09:06.097433  393795 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:09:06.097463  393795 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:09:06.098457  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:09:06.115876  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:09:06.132057  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:09:06.147925  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813200824-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 20:09:06.164201  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:09:06.180445  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:09:06.196788  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:09:06.212845  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:09:06.230237  393795 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:09:06.245702  393795 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:09:06.257408  393795 ssh_runner.go:149] Run: openssl version

	I0813 20:09:06.263142  393795 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:09:06.270488  393795 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:09:06.274969  393795 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:09:06.275003  393795 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:09:06.280557  393795 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:09:06.287958  393795 kubeadm.go:390] StartCluster: {Name:addons-20210813200824-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 C

lusterName:addons-20210813200824-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.71 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:09:06.288034  393795 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:09:06.288066  393795 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:09:06.320965  393795 cri.go:76] found id: ""

	I0813 20:09:06.321013  393795 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:09:06.328453  393795 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:09:06.335304  393795 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 20:09:06.342744  393795 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 20:09:06.342773  393795 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem"

	I0813 20:09:06.772726  393795 out.go:204]   - Generating certificates and keys ...

	I0813 20:09:09.464601  393795 out.go:204]   - Booting up control plane ...

	I0813 20:09:25.072144  393795 out.go:204]   - Configuring RBAC rules ...

	I0813 20:09:25.621263  393795 cni.go:93] Creating CNI manager for ""

	I0813 20:09:25.621288  393795 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:09:25.622976  393795 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0813 20:09:25.623052  393795 ssh_runner.go:149] Run: sudo mkdir -p /etc/cni/net.d

	I0813 20:09:25.630424  393795 ssh_runner.go:316] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0813 20:09:25.644240  393795 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 20:09:25.644322  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:25.644344  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl label nodes minikube.k8s.io/version=v1.22.0 minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c minikube.k8s.io/name=addons-20210813200824-393438 minikube.k8s.io/updated_at=2021_08_13T20_09_25_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:25.664957  393795 ops.go:34] apiserver oom_adj: -16

	I0813 20:09:25.841471  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:26.446306  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:26.946622  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:27.446349  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:27.946278  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:28.445926  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:28.945957  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:29.446607  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:29.945830  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:30.446558  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:30.946354  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:31.446034  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:31.945706  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:32.445838  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:32.946025  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:33.446148  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:33.946140  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:34.446258  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:34.946216  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:35.446132  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:35.945825  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:36.446715  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:36.945790  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:37.445753  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:37.946438  393795 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:09:38.057420  393795 kubeadm.go:985] duration metric: took 12.413153203s to wait for elevateKubeSystemPrivileges.

	I0813 20:09:38.057458  393795 kubeadm.go:392] StartCluster complete in 31.769507081s

	I0813 20:09:38.057491  393795 settings.go:142] acquiring lock: {Name:mk2e042a75d7d4722d2a29030eed8e43c687ad8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:38.057650  393795 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:09:38.058158  393795 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:09:38.583680  393795 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "addons-20210813200824-393438" rescaled to 1

	I0813 20:09:38.583782  393795 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.39.71 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 20:09:38.585601  393795 out.go:177] * Verifying Kubernetes components...

	I0813 20:09:38.585676  393795 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:09:38.583828  393795 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 20:09:38.583856  393795 addons.go:342] enableAddons start: toEnable=map[], additional=[registry metrics-server olm volumesnapshots csi-hostpath-driver ingress helm-tiller]

	I0813 20:09:38.585893  393795 addons.go:59] Setting volumesnapshots=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.585916  393795 addons.go:135] Setting addon volumesnapshots=true in "addons-20210813200824-393438"

	I0813 20:09:38.585948  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.586330  393795 addons.go:59] Setting ingress=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586356  393795 addons.go:135] Setting addon ingress=true in "addons-20210813200824-393438"

	I0813 20:09:38.586391  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.586498  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.586554  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.586738  393795 addons.go:59] Setting csi-hostpath-driver=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586758  393795 addons.go:59] Setting olm=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586767  393795 addons.go:59] Setting default-storageclass=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586786  393795 addons.go:59] Setting metrics-server=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586787  393795 addons.go:135] Setting addon csi-hostpath-driver=true in "addons-20210813200824-393438"

	I0813 20:09:38.586797  393795 addons.go:135] Setting addon metrics-server=true in "addons-20210813200824-393438"

	I0813 20:09:38.586804  393795 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-20210813200824-393438"

	I0813 20:09:38.586819  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.586825  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.586834  393795 addons.go:59] Setting helm-tiller=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.586845  393795 addons.go:135] Setting addon helm-tiller=true in "addons-20210813200824-393438"

	I0813 20:09:38.586868  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.587221  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.586776  393795 addons.go:135] Setting addon olm=true in "addons-20210813200824-393438"

	I0813 20:09:38.587237  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.587243  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.586824  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.587275  393795 addons.go:59] Setting registry=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.587278  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.587278  393795 addons.go:59] Setting storage-provisioner=true in profile "addons-20210813200824-393438"

	I0813 20:09:38.587286  393795 addons.go:135] Setting addon registry=true in "addons-20210813200824-393438"

	I0813 20:09:38.587292  393795 addons.go:135] Setting addon storage-provisioner=true in "addons-20210813200824-393438"

	W0813 20:09:38.587301  393795 addons.go:147] addon storage-provisioner should already be in state true

	I0813 20:09:38.587316  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.587327  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.587232  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.587428  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.587290  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.587262  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.587717  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.587745  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.584019  393795 config.go:177] Loaded profile config "addons-20210813200824-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:09:38.587263  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.587270  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.587690  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.588061  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.588126  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.588166  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.599327  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:36999

	I0813 20:09:38.599340  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:45269

	I0813 20:09:38.599894  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.599944  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.600483  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.600493  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.600511  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.600512  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.600902  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.600953  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.601519  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.601521  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.601567  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.601579  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.608399  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:36339

	I0813 20:09:38.608473  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:35771

	I0813 20:09:38.610658  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.610966  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.613738  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.613766  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.613786  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.613840  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.615406  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40933

	I0813 20:09:38.615583  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.615582  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.615910  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.616433  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.616474  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.616505  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.616545  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.616688  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:46227

	I0813 20:09:38.616738  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.616759  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.617287  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.622516  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:42275

	I0813 20:09:38.626113  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:39883

	I0813 20:09:38.628255  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37519

	I0813 20:09:38.634699  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40233

	I0813 20:09:38.643508  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.643538  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.643611  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.643750  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.643804  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.643903  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.644061  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.644079  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.644468  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.644555  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.644563  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.644572  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.644576  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.644589  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.644591  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.644934  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.645073  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.644989  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.645021  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.645189  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.645075  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.645356  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.645449  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.645599  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.645623  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.645655  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.645660  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.646385  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.647005  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.647041  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.649051  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.651353  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/snapshot-controller:v4.0.0

	I0813 20:09:38.651440  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0813 20:09:38.651452  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0813 20:09:38.651467  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.657406  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:38847

	I0813 20:09:38.657776  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.657905  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.658353  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.658392  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.658474  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.658495  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.658891  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.658953  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.659075  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.659207  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.659253  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.659298  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37571

	I0813 20:09:38.659561  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.659689  393795 addons.go:135] Setting addon default-storageclass=true in "addons-20210813200824-393438"

	W0813 20:09:38.659706  393795 addons.go:147] addon default-storageclass should already be in state true

	I0813 20:09:38.659734  393795 host.go:66] Checking if "addons-20210813200824-393438" exists ...

	I0813 20:09:38.659820  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.660124  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.660170  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.660237  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.660256  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.660596  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.660748  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.662213  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.664053  393795 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I0813 20:09:38.663704  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.665661  393795 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I0813 20:09:38.666969  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0

	I0813 20:09:38.668442  393795 out.go:177]   - Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0

	I0813 20:09:38.669991  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1

	I0813 20:09:38.667263  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:36063

	I0813 20:09:38.667955  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:44991

	I0813 20:09:38.668516  393795 addons.go:275] installing /etc/kubernetes/addons/ingress-configmap.yaml

	I0813 20:09:38.670474  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.671395  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/hostpathplugin:v1.6.0

	I0813 20:09:38.672813  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-controller:v0.2.0

	I0813 20:09:38.671520  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes)

	I0813 20:09:38.672861  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.672219  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.674410  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-agent:v0.2.0

	I0813 20:09:38.672343  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.674294  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.676357  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0

	I0813 20:09:38.676375  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.677765  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-attacher:v3.1.0

	I0813 20:09:38.676359  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.676821  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.679091  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:34211

	I0813 20:09:38.679311  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/livenessprobe:v2.2.0

	I0813 20:09:38.680774  393795 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-resizer:v1.1.0

	I0813 20:09:38.680832  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0813 20:09:38.679711  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37447

	I0813 20:09:38.680847  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0813 20:09:38.680866  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.679716  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.679747  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.679904  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.679956  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.681034  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.681063  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.680591  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.681221  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.681411  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.681515  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.681533  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.681926  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.682413  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.682418  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.682433  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.682458  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37371

	I0813 20:09:38.682628  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.682895  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.683072  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.683089  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.683458  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.683476  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.683485  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.683875  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.683893  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:38843

	I0813 20:09:38.683913  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.684103  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.684438  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.684959  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.684976  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.685495  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.686043  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.686108  393795 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:09:38.686149  393795 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:09:38.688062  393795 out.go:177]   - Using image k8s.gcr.io/metrics-server/metrics-server:v0.4.2

	I0813 20:09:38.688182  393795 addons.go:275] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0813 20:09:38.688196  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0813 20:09:38.688240  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.688927  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.690965  393795 out.go:177]   - Using image quay.io/operator-framework/olm:v0.17.0

	I0813 20:09:38.689497  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.689897  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.692351  393795 out.go:177]   - Using image quay.io/operator-framework/upstream-community-operators:07bbc13

	I0813 20:09:38.690466  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.693902  393795 out.go:177]   - Using image registry:2.7.1

	I0813 20:09:38.695194  393795 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:09:38.691513  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.695301  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.695312  393795 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:09:38.695323  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 20:09:38.695329  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.692022  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.695343  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.696913  393795 out.go:177]   - Using image gcr.io/kubernetes-helm/tiller:v2.16.12

	I0813 20:09:38.698339  393795 out.go:177]   - Using image gcr.io/google_containers/kube-registry-proxy:0.4

	I0813 20:09:38.695132  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.698469  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.698487  393795 addons.go:275] installing /etc/kubernetes/addons/registry-rc.yaml

	I0813 20:09:38.698498  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.695513  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.698502  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (788 bytes)

	I0813 20:09:38.698561  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.695710  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.697004  393795 addons.go:275] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0813 20:09:38.698637  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2433 bytes)

	I0813 20:09:38.698652  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.698759  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.698930  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.699738  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.699919  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.700090  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.700783  393795 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:41897

	I0813 20:09:38.701204  393795 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:09:38.701787  393795 main.go:130] libmachine: Using API Version  1

	I0813 20:09:38.701805  393795 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:09:38.701827  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.702203  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.702231  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.702306  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.702381  393795 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:09:38.702580  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.702583  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetState

	I0813 20:09:38.702749  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.702954  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.706057  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.707097  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.707122  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.707318  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.707490  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.707584  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .DriverName

	I0813 20:09:38.707665  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.707776  393795 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 20:09:38.707786  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 20:09:38.707801  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.707838  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.708166  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.708589  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.708620  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.708788  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.708962  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.709122  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.709354  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.713619  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.715440  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.715473  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.715514  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.715673  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.715769  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.715904  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.717384  393795 addons.go:275] installing /etc/kubernetes/addons/crds.yaml

	I0813 20:09:38.717419  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/crds.yaml (825331 bytes)

	I0813 20:09:38.717441  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHHostname

	I0813 20:09:38.722655  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.723050  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1a:a8:f0", ip: ""} in network mk-addons-20210813200824-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:08:39 +0000 UTC Type:0 Mac:52:54:00:1a:a8:f0 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:addons-20210813200824-393438 Clientid:01:52:54:00:1a:a8:f0}

	I0813 20:09:38.723082  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | domain addons-20210813200824-393438 has defined IP address 192.168.39.71 and MAC address 52:54:00:1a:a8:f0 in network mk-addons-20210813200824-393438

	I0813 20:09:38.723242  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHPort

	I0813 20:09:38.723412  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHKeyPath

	I0813 20:09:38.723604  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .GetSSHUsername

	I0813 20:09:38.723771  393795 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813200824-393438/id_rsa Username:docker}

	I0813 20:09:38.883443  393795 addons.go:275] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0813 20:09:38.883466  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0813 20:09:38.959885  393795 addons.go:275] installing /etc/kubernetes/addons/ingress-rbac.yaml

	I0813 20:09:38.959907  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes)

	I0813 20:09:38.993909  393795 addons.go:275] installing /etc/kubernetes/addons/ingress-dp.yaml

	I0813 20:09:38.993934  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9394 bytes)

	I0813 20:09:39.031522  393795 addons.go:275] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0813 20:09:39.031543  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0813 20:09:39.064037  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml

	I0813 20:09:39.064055  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml (2203 bytes)

	I0813 20:09:39.106028  393795 addons.go:275] installing /etc/kubernetes/addons/olm.yaml

	I0813 20:09:39.106056  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/olm.yaml (9882 bytes)

	I0813 20:09:39.145373  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:09:39.156561  393795 addons.go:275] installing /etc/kubernetes/addons/registry-svc.yaml

	I0813 20:09:39.156587  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0813 20:09:39.166653  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml

	I0813 20:09:39.166974  393795 addons.go:275] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0813 20:09:39.166997  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19584 bytes)

	I0813 20:09:39.173293  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0813 20:09:39.173315  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3037 bytes)

	I0813 20:09:39.181574  393795 addons.go:275] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0813 20:09:39.181595  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0813 20:09:39.209215  393795 addons.go:275] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0813 20:09:39.209236  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1931 bytes)

	I0813 20:09:39.257097  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 20:09:39.278863  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0813 20:09:39.278890  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3428 bytes)

	I0813 20:09:39.297262  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml

	I0813 20:09:39.310095  393795 addons.go:275] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0813 20:09:39.310115  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (950 bytes)

	I0813 20:09:39.317291  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0813 20:09:39.317311  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (3666 bytes)

	I0813 20:09:39.317891  393795 addons.go:275] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0813 20:09:39.317908  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0813 20:09:39.365267  393795 addons.go:275] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0813 20:09:39.365289  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)

	I0813 20:09:39.382927  393795 addons.go:275] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0813 20:09:39.382945  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1071 bytes)

	I0813 20:09:39.405292  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0813 20:09:39.405311  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2944 bytes)

	I0813 20:09:39.441402  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0813 20:09:39.455719  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0813 20:09:39.654504  393795 addons.go:275] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0813 20:09:39.654538  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)

	I0813 20:09:39.671707  393795 addons.go:275] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0813 20:09:39.671730  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3194 bytes)

	I0813 20:09:39.680358  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0813 20:09:39.762701  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0813 20:09:39.762758  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2421 bytes)

	I0813 20:09:39.826196  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0813 20:09:40.018251  393795 ssh_runner.go:189] Completed: sudo systemctl is-active --quiet service kubelet: (1.43251719s)

	I0813 20:09:40.018350  393795 ssh_runner.go:189] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.432536411s)

	I0813 20:09:40.018500  393795 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0813 20:09:40.020116  393795 node_ready.go:35] waiting up to 6m0s for node "addons-20210813200824-393438" to be "Ready" ...

	I0813 20:09:40.025781  393795 node_ready.go:49] node "addons-20210813200824-393438" has status "Ready":"True"

	I0813 20:09:40.025799  393795 node_ready.go:38] duration metric: took 5.661267ms waiting for node "addons-20210813200824-393438" to be "Ready" ...

	I0813 20:09:40.025807  393795 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 20:09:40.037290  393795 pod_ready.go:78] waiting up to 6m0s for pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:40.289237  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0813 20:09:40.289263  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1034 bytes)

	I0813 20:09:40.464340  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0813 20:09:40.464366  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (6710 bytes)

	I0813 20:09:40.786713  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-provisioner.yaml

	I0813 20:09:40.786741  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-provisioner.yaml (2555 bytes)

	I0813 20:09:40.989824  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0813 20:09:40.989855  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2469 bytes)

	I0813 20:09:41.120250  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml

	I0813 20:09:41.120276  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml (2555 bytes)

	I0813 20:09:41.289338  393795 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0813 20:09:41.289378  393795 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0813 20:09:41.524570  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-provisioner.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0813 20:09:42.079421  393795 pod_ready.go:102] pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace has status "Ready":"False"

	I0813 20:09:43.501421  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.356001422s)

	I0813 20:09:43.501499  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:43.501519  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:43.501814  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:43.501865  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:43.501882  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:43.501898  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:43.502173  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:43.502201  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:43.502234  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:44.115338  393795 pod_ready.go:102] pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace has status "Ready":"False"

	I0813 20:09:46.310798  393795 pod_ready.go:102] pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace has status "Ready":"False"

	I0813 20:09:46.497112  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml: (7.330408833s)

	I0813 20:09:46.497158  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.240024175s)

	I0813 20:09:46.497172  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:46.497193  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:46.497208  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:46.497237  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:46.497505  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:46.497522  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:46.497526  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:46.497532  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:46.497544  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:46.497527  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:46.497556  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:46.497566  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:46.497545  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:46.497756  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:46.497770  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:46.497781  393795 addons.go:313] Verifying addon ingress=true in "addons-20210813200824-393438"

	I0813 20:09:46.499409  393795 out.go:177] * Verifying ingress addon...

	I0813 20:09:46.498031  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:46.499507  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:46.499520  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:46.499526  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:46.498069  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:46.499718  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:46.499744  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:46.499753  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:46.501202  393795 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0813 20:09:46.616926  393795 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0813 20:09:46.616952  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:47.174883  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:47.575472  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (8.134035979s)

	I0813 20:09:47.575528  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml: (8.278237583s)

	W0813 20:09:47.575565  393795 addons.go:296] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com created

	namespace/olm created

	namespace/operators created

	serviceaccount/olm-operator-serviceaccount created

	clusterrole.rbac.authorization.k8s.io/system:controller:operator-lifecycle-manager created

	clusterrolebinding.rbac.authorization.k8s.io/olm-operator-binding-olm created

	deployment.apps/olm-operator created

	deployment.apps/catalog-operator created

	clusterrole.rbac.authorization.k8s.io/aggregate-olm-edit created

	clusterrole.rbac.authorization.k8s.io/aggregate-olm-view created

	stderr:

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "OperatorGroup" in version "operators.coreos.com/v1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "OperatorGroup" in version "operators.coreos.com/v1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "ClusterServiceVersion" in version "operators.coreos.com/v1alpha1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "CatalogSource" in version "operators.coreos.com/v1alpha1"

	I0813 20:09:47.575572  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.119820239s)

	I0813 20:09:47.575610  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.575582  393795 retry.go:31] will retry after 360.127272ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/catalogsources.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/clusterserviceversions.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/installplans.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/operatorgroups.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/operators.operators.coreos.com created

	customresourcedefinition.apiextensions.k8s.io/subscriptions.operators.coreos.com created

	namespace/olm created

	namespace/operators created

	serviceaccount/olm-operator-serviceaccount created

	clusterrole.rbac.authorization.k8s.io/system:controller:operator-lifecycle-manager created

	clusterrolebinding.rbac.authorization.k8s.io/olm-operator-binding-olm created

	deployment.apps/olm-operator created

	deployment.apps/catalog-operator created

	clusterrole.rbac.authorization.k8s.io/aggregate-olm-edit created

	clusterrole.rbac.authorization.k8s.io/aggregate-olm-view created

	stderr:

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "OperatorGroup" in version "operators.coreos.com/v1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "OperatorGroup" in version "operators.coreos.com/v1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "ClusterServiceVersion" in version "operators.coreos.com/v1alpha1"

	unable to recognize "/etc/kubernetes/addons/olm.yaml": no matches for kind "CatalogSource" in version "operators.coreos.com/v1alpha1"

	I0813 20:09:47.575624  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.575527  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.575700  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.575759  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.895360884s)

	W0813 20:09:47.575853  393795 addons.go:296] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: unable to recognize "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	I0813 20:09:47.575905  393795 retry.go:31] will retry after 291.140013ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: unable to recognize "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	I0813 20:09:47.575918  393795 ssh_runner.go:189] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (7.557401362s)

	I0813 20:09:47.575961  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.575976  393795 start.go:728] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS

	I0813 20:09:47.575917  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.575995  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.575872  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.749639094s)

	I0813 20:09:47.576005  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.576015  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.576019  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.576025  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.576028  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.576037  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.575999  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.576080  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.576089  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.577766  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.577774  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.577781  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.577828  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.577782  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.577842  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.577871  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.577888  393795 addons.go:313] Verifying addon registry=true in "addons-20210813200824-393438"

	I0813 20:09:47.577849  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.577985  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:47.577995  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:47.577796  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.579721  393795 out.go:177] * Verifying registry addon...

	I0813 20:09:47.578189  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:47.579814  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:47.579831  393795 addons.go:313] Verifying addon metrics-server=true in "addons-20210813200824-393438"

	I0813 20:09:47.578253  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:47.581527  393795 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0813 20:09:47.612135  393795 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0813 20:09:47.612155  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:47.646856  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:47.867719  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0813 20:09:47.936634  393795 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml

	I0813 20:09:48.128796  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:48.140721  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:48.639735  393795 pod_ready.go:102] pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace has status "Ready":"False"

	I0813 20:09:48.790278  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:48.790855  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:49.245523  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:49.249658  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:49.525356  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-provisioner.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (8.000707313s)

	I0813 20:09:49.525446  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:49.525462  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:49.525774  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:49.525795  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:49.525813  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:49.525814  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:49.525824  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:49.526056  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:49.526073  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:49.526084  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:49.526084  393795 addons.go:313] Verifying addon csi-hostpath-driver=true in "addons-20210813200824-393438"

	I0813 20:09:49.528027  393795 out.go:177] * Verifying csi-hostpath-driver addon...

	I0813 20:09:49.529626  393795 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0813 20:09:49.540617  393795 kapi.go:86] Found 5 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0813 20:09:49.540635  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:49.630507  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:49.630609  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:50.066907  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:50.093522  393795 pod_ready.go:92] pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.093549  393795 pod_ready.go:81] duration metric: took 10.056233221s waiting for pod "coredns-558bd4d5db-2tfm4" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.093559  393795 pod_ready.go:78] waiting up to 6m0s for pod "coredns-558bd4d5db-nvvhj" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.097783  393795 pod_ready.go:97] error getting pod "coredns-558bd4d5db-nvvhj" in "kube-system" namespace (skipping!): pods "coredns-558bd4d5db-nvvhj" not found

	I0813 20:09:50.097805  393795 pod_ready.go:81] duration metric: took 4.239831ms waiting for pod "coredns-558bd4d5db-nvvhj" in "kube-system" namespace to be "Ready" ...

	E0813 20:09:50.097818  393795 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-558bd4d5db-nvvhj" in "kube-system" namespace (skipping!): pods "coredns-558bd4d5db-nvvhj" not found

	I0813 20:09:50.097831  393795 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.105177  393795 pod_ready.go:92] pod "etcd-addons-20210813200824-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.105193  393795 pod_ready.go:81] duration metric: took 7.352925ms waiting for pod "etcd-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.105201  393795 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.111294  393795 pod_ready.go:92] pod "kube-apiserver-addons-20210813200824-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.111310  393795 pod_ready.go:81] duration metric: took 6.101978ms waiting for pod "kube-apiserver-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.111320  393795 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.121666  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:50.123409  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:50.125829  393795 pod_ready.go:92] pod "kube-controller-manager-addons-20210813200824-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.125851  393795 pod_ready.go:81] duration metric: took 14.523533ms waiting for pod "kube-controller-manager-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.125864  393795 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-tz56r" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.271429  393795 pod_ready.go:92] pod "kube-proxy-tz56r" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.271450  393795 pod_ready.go:81] duration metric: took 145.574615ms waiting for pod "kube-proxy-tz56r" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.271461  393795 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.552633  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:50.618655  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:50.620974  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:50.669835  393795 pod_ready.go:92] pod "kube-scheduler-addons-20210813200824-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:09:50.669855  393795 pod_ready.go:81] duration metric: took 398.386493ms waiting for pod "kube-scheduler-addons-20210813200824-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:09:50.669865  393795 pod_ready.go:38] duration metric: took 10.644047612s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 20:09:50.669885  393795 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:09:50.669931  393795 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:09:51.053820  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:51.119257  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:51.125096  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:51.361875  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.494086135s)

	I0813 20:09:51.361942  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:51.361956  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:51.362251  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:51.362304  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:51.362318  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:51.362374  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:51.362390  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:51.362606  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:51.362656  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:51.362686  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:51.549635  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:51.627038  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:51.627214  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:52.046032  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:52.140128  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:52.140440  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:52.616678  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:52.687974  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:52.705638  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:52.955125  393795 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/crds.yaml -f /etc/kubernetes/addons/olm.yaml: (5.018448349s)

	I0813 20:09:52.955165  393795 ssh_runner.go:189] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (2.285214304s)

	I0813 20:09:52.955186  393795 api_server.go:70] duration metric: took 14.371365473s to wait for apiserver process to appear ...

	I0813 20:09:52.955194  393795 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:09:52.955192  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:52.955205  393795 api_server.go:239] Checking apiserver healthz at https://192.168.39.71:8443/healthz ...

	I0813 20:09:52.955225  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:52.955612  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:52.955637  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:52.955649  393795 main.go:130] libmachine: Making call to close driver server

	I0813 20:09:52.955665  393795 main.go:130] libmachine: (addons-20210813200824-393438) Calling .Close

	I0813 20:09:52.955693  393795 main.go:130] libmachine: (addons-20210813200824-393438) DBG | Closing plugin on server side

	I0813 20:09:52.955913  393795 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:09:52.955930  393795 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:09:52.964908  393795 api_server.go:265] https://192.168.39.71:8443/healthz returned 200:

	ok

	I0813 20:09:52.965928  393795 api_server.go:139] control plane version: v1.21.3

	I0813 20:09:52.965944  393795 api_server.go:129] duration metric: took 10.744185ms to wait for apiserver health ...

	I0813 20:09:52.965952  393795 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 20:09:52.987760  393795 system_pods.go:59] 18 kube-system pods found

	I0813 20:09:52.987805  393795 system_pods.go:61] "coredns-558bd4d5db-2tfm4" [8c83bfa0-cf21-4b94-ae75-e9ec1ec3bea9] Running

	I0813 20:09:52.987813  393795 system_pods.go:61] "csi-hostpath-attacher-0" [693a4034-9d0d-48fa-94af-c786d7758597] Pending

	I0813 20:09:52.987819  393795 system_pods.go:61] "csi-hostpath-provisioner-0" [afce731b-2eb1-412b-9091-2dc0a1a021a9] Pending

	I0813 20:09:52.987829  393795 system_pods.go:61] "csi-hostpath-resizer-0" [d54d1c38-b5ed-4549-be19-af03c3f20316] Pending

	I0813 20:09:52.987841  393795 system_pods.go:61] "csi-hostpath-snapshotter-0" [c90067b7-84ec-447b-b688-d02a0e676b7d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-snapshotter])

	I0813 20:09:52.987855  393795 system_pods.go:61] "csi-hostpathplugin-0" [a311fddd-ed33-4f65-a513-2dfef644826e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-agent csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-agent csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe])

	I0813 20:09:52.987867  393795 system_pods.go:61] "etcd-addons-20210813200824-393438" [a43d3749-089e-4b6d-ac9f-20d2efd0a1fa] Running

	I0813 20:09:52.987877  393795 system_pods.go:61] "kube-apiserver-addons-20210813200824-393438" [d28ca15b-5eae-4c4e-b9c3-0c0622ed4585] Running

	I0813 20:09:52.987886  393795 system_pods.go:61] "kube-controller-manager-addons-20210813200824-393438" [1f7b8d18-b800-46c4-9075-2dc0f88979d5] Running

	I0813 20:09:52.987892  393795 system_pods.go:61] "kube-proxy-tz56r" [fcbba51d-011a-43d5-b34b-880cf73c8792] Running

	I0813 20:09:52.987902  393795 system_pods.go:61] "kube-scheduler-addons-20210813200824-393438" [606cb4e1-11f1-42ee-8986-851f91051a62] Running

	I0813 20:09:52.987910  393795 system_pods.go:61] "metrics-server-77c99ccb96-9567z" [f3e2b887-96a1-4798-862b-2cce165f6e71] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0813 20:09:52.987922  393795 system_pods.go:61] "registry-5svq5" [e46e7721-b1fa-4ead-b2e2-c7e63d60991a] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0813 20:09:52.987936  393795 system_pods.go:61] "registry-proxy-tqczv" [753222c4-f8c8-4036-aaaf-76542b374291] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0813 20:09:52.987950  393795 system_pods.go:61] "snapshot-controller-989f9ddc8-n5hps" [a734c119-4bbf-41d1-878e-220f971d4eb5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0813 20:09:52.987964  393795 system_pods.go:61] "snapshot-controller-989f9ddc8-nbw4s" [0a5681bf-2ab3-4d43-89f4-979100af9d85] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0813 20:09:52.987977  393795 system_pods.go:61] "storage-provisioner" [18c67738-f79c-43e7-8251-6887d8b8a3c5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 20:09:52.987991  393795 system_pods.go:61] "tiller-deploy-768d69497-dhd7f" [b66f31a9-eec4-4952-a7d1-5e6338a26140] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])

	I0813 20:09:52.988001  393795 system_pods.go:74] duration metric: took 22.044156ms to wait for pod list to return data ...

	I0813 20:09:52.988011  393795 default_sa.go:34] waiting for default service account to be created ...

	I0813 20:09:53.022489  393795 default_sa.go:45] found service account: "default"

	I0813 20:09:53.022516  393795 default_sa.go:55] duration metric: took 34.494493ms for default service account to be created ...

	I0813 20:09:53.022528  393795 system_pods.go:116] waiting for k8s-apps to be running ...

	I0813 20:09:53.037424  393795 system_pods.go:86] 18 kube-system pods found

	I0813 20:09:53.037449  393795 system_pods.go:89] "coredns-558bd4d5db-2tfm4" [8c83bfa0-cf21-4b94-ae75-e9ec1ec3bea9] Running

	I0813 20:09:53.037455  393795 system_pods.go:89] "csi-hostpath-attacher-0" [693a4034-9d0d-48fa-94af-c786d7758597] Pending

	I0813 20:09:53.037460  393795 system_pods.go:89] "csi-hostpath-provisioner-0" [afce731b-2eb1-412b-9091-2dc0a1a021a9] Pending

	I0813 20:09:53.037463  393795 system_pods.go:89] "csi-hostpath-resizer-0" [d54d1c38-b5ed-4549-be19-af03c3f20316] Pending

	I0813 20:09:53.037474  393795 system_pods.go:89] "csi-hostpath-snapshotter-0" [c90067b7-84ec-447b-b688-d02a0e676b7d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-snapshotter])

	I0813 20:09:53.037484  393795 system_pods.go:89] "csi-hostpathplugin-0" [a311fddd-ed33-4f65-a513-2dfef644826e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-agent csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-agent csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe])

	I0813 20:09:53.037493  393795 system_pods.go:89] "etcd-addons-20210813200824-393438" [a43d3749-089e-4b6d-ac9f-20d2efd0a1fa] Running

	I0813 20:09:53.037501  393795 system_pods.go:89] "kube-apiserver-addons-20210813200824-393438" [d28ca15b-5eae-4c4e-b9c3-0c0622ed4585] Running

	I0813 20:09:53.037508  393795 system_pods.go:89] "kube-controller-manager-addons-20210813200824-393438" [1f7b8d18-b800-46c4-9075-2dc0f88979d5] Running

	I0813 20:09:53.037514  393795 system_pods.go:89] "kube-proxy-tz56r" [fcbba51d-011a-43d5-b34b-880cf73c8792] Running

	I0813 20:09:53.037521  393795 system_pods.go:89] "kube-scheduler-addons-20210813200824-393438" [606cb4e1-11f1-42ee-8986-851f91051a62] Running

	I0813 20:09:53.037528  393795 system_pods.go:89] "metrics-server-77c99ccb96-9567z" [f3e2b887-96a1-4798-862b-2cce165f6e71] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0813 20:09:53.037533  393795 system_pods.go:89] "registry-5svq5" [e46e7721-b1fa-4ead-b2e2-c7e63d60991a] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0813 20:09:53.037542  393795 system_pods.go:89] "registry-proxy-tqczv" [753222c4-f8c8-4036-aaaf-76542b374291] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0813 20:09:53.037549  393795 system_pods.go:89] "snapshot-controller-989f9ddc8-n5hps" [a734c119-4bbf-41d1-878e-220f971d4eb5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0813 20:09:53.037562  393795 system_pods.go:89] "snapshot-controller-989f9ddc8-nbw4s" [0a5681bf-2ab3-4d43-89f4-979100af9d85] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0813 20:09:53.037572  393795 system_pods.go:89] "storage-provisioner" [18c67738-f79c-43e7-8251-6887d8b8a3c5] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 20:09:53.037581  393795 system_pods.go:89] "tiller-deploy-768d69497-dhd7f" [b66f31a9-eec4-4952-a7d1-5e6338a26140] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])

	I0813 20:09:53.037592  393795 system_pods.go:126] duration metric: took 15.057891ms to wait for k8s-apps to be running ...

	I0813 20:09:53.037601  393795 system_svc.go:44] waiting for kubelet service to be running ....

	I0813 20:09:53.037650  393795 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:09:53.056761  393795 system_svc.go:56] duration metric: took 19.155194ms WaitForService to wait for kubelet.

	I0813 20:09:53.056786  393795 kubeadm.go:547] duration metric: took 14.47296686s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0813 20:09:53.056805  393795 node_conditions.go:102] verifying NodePressure condition ...

	I0813 20:09:53.071698  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:53.082121  393795 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0813 20:09:53.082146  393795 node_conditions.go:123] node cpu capacity is 2

	I0813 20:09:53.082161  393795 node_conditions.go:105] duration metric: took 25.351763ms to run NodePressure ...

	I0813 20:09:53.082170  393795 start.go:231] waiting for startup goroutines ...

	I0813 20:09:53.135484  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:53.135831  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:53.546753  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:53.617725  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:53.624343  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:54.107444  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:54.126823  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:54.134995  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:54.551048  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:54.620421  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:54.624469  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:55.047334  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:55.119390  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:55.124655  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:55.559762  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:55.618528  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:55.628164  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:56.052643  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:56.121580  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:56.123711  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:56.549004  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:56.618048  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:56.623479  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:57.055925  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:57.120034  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:57.123256  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:57.548168  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:57.617559  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:57.620927  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:58.048353  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:58.117159  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:58.120471  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:58.549091  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:58.616699  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:58.620868  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:59.056972  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:59.116982  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:59.124654  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:09:59.547139  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:09:59.624786  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:09:59.628304  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:00.047495  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:00.119540  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:00.122983  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:00.547976  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:00.617461  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:00.621086  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:01.065738  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:01.118920  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:01.122088  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:01.573288  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:01.623421  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:01.625722  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:02.046315  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:02.117886  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:02.121486  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:02.551665  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:02.624306  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:02.625820  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:03.049929  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:03.117277  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:03.121064  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:03.547627  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:03.624732  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:03.627066  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:04.049679  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:04.119291  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:04.121497  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:04.552850  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:04.638494  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:04.639397  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:05.059369  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:05.138758  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:05.150516  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:05.570407  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:05.628272  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:05.629076  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:06.110391  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:06.118172  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:06.141644  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:06.554002  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:06.628088  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:06.637241  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:07.050356  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:07.141412  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:07.141566  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:07.546967  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:07.616357  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:07.627367  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:08.102318  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:08.291583  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:08.291600  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:08.550319  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:08.620560  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:08.630347  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:09.078463  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:09.118587  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:09.121381  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:09.552227  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:09.623455  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:09.624643  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:10.048268  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:10.123065  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:10.124537  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:10.547376  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:10.617884  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:10.621395  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:11.047193  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:11.117134  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:11.120316  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:11.584369  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:11.621816  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:11.625581  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:12.047882  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:12.122235  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:12.133256  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:12.549914  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:12.617136  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:12.620243  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:13.047543  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:13.117218  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:13.120838  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:13.545911  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:13.616978  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:13.620547  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:14.053543  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:14.122347  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:14.131774  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:14.547187  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:14.617079  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:14.620325  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:15.047240  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:15.121756  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:15.123510  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:15.548100  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:15.624285  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:15.627983  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:16.054580  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:16.122976  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:16.126345  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:16.567087  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:16.618465  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:16.621630  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:17.047902  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:17.117168  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:17.120538  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:17.552944  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:17.617890  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:17.620642  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:18.048206  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:18.123556  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:18.127644  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:18.545506  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:18.617363  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:18.620329  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:19.047815  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:19.122114  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:19.124139  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:19.552620  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:19.629874  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:19.636268  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:20.047059  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:20.117974  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:20.121371  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:20.546295  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:20.616662  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:20.623186  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:21.046137  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:21.117107  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:21.159274  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:21.546465  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:21.617931  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:21.621446  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:22.072576  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:22.119216  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:22.122046  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:22.547531  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:22.618405  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:22.622111  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:23.045636  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:23.117099  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:23.120698  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:23.558909  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:23.621855  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:23.625197  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:24.047281  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:24.117743  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:24.120357  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:24.550480  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:24.618186  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:24.621735  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:25.049506  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:25.117356  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:25.121864  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:25.546533  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:25.620243  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0813 20:10:25.622547  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:26.049763  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:26.120480  393795 kapi.go:108] duration metric: took 38.538947676s to wait for kubernetes.io/minikube-addons=registry ...

	I0813 20:10:26.123696  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:26.546776  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:26.622303  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:27.048722  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:27.123060  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:27.546444  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:27.629315  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:28.049854  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:28.122398  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:28.554848  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:28.623609  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:29.054207  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:29.120551  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:29.547042  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:29.622329  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:30.053433  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:30.122243  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:30.546149  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:30.620691  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:31.053904  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:31.124986  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:31.560035  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:31.622639  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:32.048338  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:32.125154  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:32.546769  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:32.621242  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:33.047992  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:33.124312  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:33.548871  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:33.622046  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:34.046877  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:34.124528  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:34.547045  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:34.621988  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:35.072168  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:35.363607  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:35.580435  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:35.623141  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:36.051282  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:36.124046  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:36.546063  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:36.622476  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:37.046056  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:37.140020  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:37.547668  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:37.624925  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:38.061397  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:38.121466  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:38.546944  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:38.629856  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:39.063922  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:39.131145  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:39.546633  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:39.622596  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:40.059675  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:40.121599  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:40.549082  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:40.621140  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:41.053747  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:41.122011  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:41.546963  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:41.623777  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:42.047529  393795 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0813 20:10:42.161825  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:42.549339  393795 kapi.go:108] duration metric: took 53.019711233s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0813 20:10:42.622045  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:43.123437  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:43.630980  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:44.121339  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:44.624213  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:45.135220  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:45.621437  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:46.124022  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:46.624309  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:47.124493  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:47.623752  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:48.127263  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:48.622079  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:49.121013  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:49.623664  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:50.121667  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:50.624587  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:51.124748  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:51.625021  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:52.122980  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:52.629321  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:53.149334  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:53.622932  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:54.128086  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:54.625633  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:55.121994  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:55.621928  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:56.122633  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:56.624752  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:57.124200  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:57.623946  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:58.121942  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:58.623073  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:59.125544  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:10:59.627375  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:00.122768  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:00.623232  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:01.491364  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:01.623739  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:02.127761  393795 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0813 20:11:02.625805  393795 kapi.go:108] duration metric: took 1m16.12459342s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0813 20:11:02.628375  393795 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, helm-tiller, metrics-server, volumesnapshots, olm, registry, csi-hostpath-driver, ingress

	I0813 20:11:02.628403  393795 addons.go:344] enableAddons completed in 1m24.044553926s

	I0813 20:11:02.674198  393795 start.go:462] kubectl: 1.20.5, cluster: 1.21.3 (minor skew: 1)

	I0813 20:11:02.676223  393795 out.go:177] * Done! kubectl is now configured to use "addons-20210813200824-393438" cluster and "default" namespace by default

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                                     ATTEMPT             POD ID

	3e737acc6b66b       4ba8776e69275       5 minutes ago       Running             etcd-restore-operator                    0                   32bebd0dae3c9

	15845df69373b       4ba8776e69275       5 minutes ago       Running             etcd-backup-operator                     0                   32bebd0dae3c9

	3736ef34faf53       4ba8776e69275       5 minutes ago       Running             etcd-operator                            0                   32bebd0dae3c9

	dd0bfd00f90e6       a90209bb39e3d       6 minutes ago       Running             private-image-eu                         0                   3aa03826536d0

	453423188a401       a90209bb39e3d       6 minutes ago       Running             private-image                            0                   8b6a284daf6c1

	194c7dd592dbb       7ce0143dee376       6 minutes ago       Running             nginx                                    0                   986d409374264

	ce3ff0151318a       56cc512116c8f       6 minutes ago       Running             busybox                                  0                   d532013303de2

	c10c8f99522b9       77a8908a12e35       7 minutes ago       Running             liveness-probe                           0                   377e7a5422ca0

	0113aee835ee4       b4d03a87a2f45       7 minutes ago       Running             hostpath                                 0                   377e7a5422ca0

	202d780fb6302       84b0f3f7f6f04       7 minutes ago       Running             node-driver-registrar                    0                   377e7a5422ca0

	9467f62999b15       d544402579747       7 minutes ago       Running             packageserver                            0                   0f9a9e7dd72e2

	672d48d6816c2       d544402579747       7 minutes ago       Running             packageserver                            0                   e9159d08adc3b

	fbf6b328ef674       fa6785e2e7324       7 minutes ago       Running             csi-external-health-monitor-controller   0                   377e7a5422ca0

	e3a767f09210e       656bd6cba647c       7 minutes ago       Running             registry-server                          0                   300bd7c31f5ea

	8312318d18ccc       f1d8a00ae690f       7 minutes ago       Running             volume-snapshot-controller               0                   ed00c7878a261

	ff54a4aa9e9fb       f1d8a00ae690f       7 minutes ago       Running             volume-snapshot-controller               0                   822fadf30e2c1

	bdd13ea6b4cad       a8fe79377034e       7 minutes ago       Running             csi-resizer                              0                   20d847f24454b

	f0668dddd469e       e0d187f105d60       7 minutes ago       Running             csi-provisioner                          0                   9276522329d96

	c6de6b93a33de       da32a49a903a6       7 minutes ago       Running             csi-snapshotter                          0                   6316376c5f8d6

	31b56f038e18f       223c6dea7afe5       8 minutes ago       Running             csi-external-health-monitor-agent        0                   377e7a5422ca0

	0d166fad4b514       03ce9595bf925       8 minutes ago       Running             csi-attacher                             0                   0ddab321ab35c

	36d8294f0e023       d544402579747       8 minutes ago       Running             olm-operator                             0                   e37cdd358d7ce

	c26856ce09abb       d544402579747       8 minutes ago       Running             catalog-operator                         0                   13b7ba0028f38

	cbfa35fa4df5f       6e38f40d628db       8 minutes ago       Running             storage-provisioner                      0                   9ee731368e492

	85e9767d83599       296a6d5035e2d       8 minutes ago       Running             coredns                                  0                   5a6286f1850ad

	87c6001e81327       adb2816ea823a       8 minutes ago       Running             kube-proxy                               0                   415e0f470cff0

	b6934d633e207       6be0dc1302e30       8 minutes ago       Running             kube-scheduler                           0                   e6907de5567d5

	ca4b86da42333       0369cf4303ffd       8 minutes ago       Running             etcd                                     0                   7e401ad660ecb

	0836c7b4d30b4       bc2bb319a7038       8 minutes ago       Running             kube-controller-manager                  0                   0ab19d123dec8

	fc458818370dc       3d174f00aa39e       8 minutes ago       Running             kube-apiserver                           0                   ad8c9d41b134f

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:08:36 UTC, end at Fri 2021-08-13 20:18:05 UTC. --

	Aug 13 20:17:41 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:41.967462852Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	Aug 13 20:17:41 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:41.975524545Z" level=info msg="Finish piping \"stderr\" of container exec \"adeafac2f01cc4ebd8040e7926aa53d0a28b3e969c8547781944cbbc91430541\""

	Aug 13 20:17:41 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:41.975546206Z" level=info msg="Finish piping \"stdout\" of container exec \"adeafac2f01cc4ebd8040e7926aa53d0a28b3e969c8547781944cbbc91430541\""

	Aug 13 20:17:41 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:41.975575357Z" level=info msg="Exec process \"adeafac2f01cc4ebd8040e7926aa53d0a28b3e969c8547781944cbbc91430541\" exits with exit code 0 and error <nil>"

	Aug 13 20:17:41 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:41.982199275Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.800898087Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" with command [grpc_health_probe -addr=:50051] and timeout 1 (s)"

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.810911738Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" with command [grpc_health_probe -addr=:50051] and timeout 5 (s)"

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.906850136Z" level=info msg="Finish piping \"stdout\" of container exec \"2b0c855874ff8a01c4d774006d8651d5c4af8aa2eb73b88f1ba2c42a6e6221b1\""

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.906865314Z" level=info msg="Finish piping \"stderr\" of container exec \"2b0c855874ff8a01c4d774006d8651d5c4af8aa2eb73b88f1ba2c42a6e6221b1\""

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.907525697Z" level=info msg="Exec process \"2b0c855874ff8a01c4d774006d8651d5c4af8aa2eb73b88f1ba2c42a6e6221b1\" exits with exit code 0 and error <nil>"

	Aug 13 20:17:51 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:51.990766356Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	Aug 13 20:17:52 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:52.005098099Z" level=info msg="Finish piping \"stderr\" of container exec \"2da892567f15878aab76b57a7b0ecee88a7322522ff74206252dc114a92c6b5d\""

	Aug 13 20:17:52 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:52.005246381Z" level=info msg="Exec process \"2da892567f15878aab76b57a7b0ecee88a7322522ff74206252dc114a92c6b5d\" exits with exit code 0 and error <nil>"

	Aug 13 20:17:52 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:52.005687037Z" level=info msg="Finish piping \"stdout\" of container exec \"2da892567f15878aab76b57a7b0ecee88a7322522ff74206252dc114a92c6b5d\""

	Aug 13 20:17:52 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:17:52.010765326Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.800926955Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" with command [grpc_health_probe -addr=:50051] and timeout 1 (s)"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.807123125Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" with command [grpc_health_probe -addr=:50051] and timeout 5 (s)"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.887766171Z" level=info msg="Finish piping \"stderr\" of container exec \"1eb444e132f294cb20fcaf6697fc6abad20c166f7813497ba969e7b3691e4416\""

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.887940721Z" level=info msg="Exec process \"1eb444e132f294cb20fcaf6697fc6abad20c166f7813497ba969e7b3691e4416\" exits with exit code 0 and error <nil>"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.888108961Z" level=info msg="Finish piping \"stdout\" of container exec \"1eb444e132f294cb20fcaf6697fc6abad20c166f7813497ba969e7b3691e4416\""

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.976263944Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.985540311Z" level=info msg="Finish piping \"stderr\" of container exec \"2c8b05367a047eace9a95197d735c421fcfc76bc38afaf62e3b653584d606f90\""

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.985753315Z" level=info msg="Finish piping \"stdout\" of container exec \"2c8b05367a047eace9a95197d735c421fcfc76bc38afaf62e3b653584d606f90\""

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.986778466Z" level=info msg="Exec process \"2c8b05367a047eace9a95197d735c421fcfc76bc38afaf62e3b653584d606f90\" exits with exit code 0 and error <nil>"

	Aug 13 20:18:01 addons-20210813200824-393438 containerd[2187]: time="2021-08-13T20:18:01.990445766Z" level=info msg="ExecSync for \"e3a767f09210ec0d1307664f83281d48d174b1bcd6c94a81b5e3e59c9b8eac39\" returns with exit code 0"

	* 

	* ==> coredns [85e9767d83599aa14549b85e80e590141318fd11e219821eb5eacd7a1c6cd258] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = 8f51b271a18f2ce6fcaee5f1cfda3ed0

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* Name:               addons-20210813200824-393438

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=addons-20210813200824-393438

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=addons-20210813200824-393438

	                    minikube.k8s.io/updated_at=2021_08_13T20_09_25_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-20210813200824-393438

	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-20210813200824-393438"}

	                    kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:09:21 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-20210813200824-393438

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:18:01 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:17:32 +0000   Fri, 13 Aug 2021 20:09:18 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:17:32 +0000   Fri, 13 Aug 2021 20:09:18 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:17:32 +0000   Fri, 13 Aug 2021 20:09:18 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:17:32 +0000   Fri, 13 Aug 2021 20:09:37 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.71

	  Hostname:    addons-20210813200824-393438

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             3935016Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             3935016Ki

	  pods:               110

	System Info:

	  Machine ID:                 7c110193e39f44e5a537f8de0ea01daf

	  System UUID:                7c110193-e39f-44e5-a537-f8de0ea01daf

	  Boot ID:                    e2e7996e-c1ef-48df-834d-4c91591fce75

	  Kernel Version:             4.19.182

	  OS Image:                   Buildroot 2020.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  containerd://1.4.9

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (25 in total)

	  Namespace                   Name                                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                    ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m36s

	  default                     nginx                                                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m30s

	  default                     private-image-7ff9c8c74f-qcb6d                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m27s

	  default                     private-image-eu-5956d58f9f-85ktb                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m12s

	  default                     task-pv-pod                                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m2s

	  kube-system                 coredns-558bd4d5db-2tfm4                                100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     8m28s

	  kube-system                 csi-hostpath-attacher-0                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m18s

	  kube-system                 csi-hostpath-provisioner-0                              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m18s

	  kube-system                 csi-hostpath-resizer-0                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m18s

	  kube-system                 csi-hostpath-snapshotter-0                              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m17s

	  kube-system                 csi-hostpathplugin-0                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m18s

	  kube-system                 etcd-addons-20210813200824-393438                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         8m35s

	  kube-system                 kube-apiserver-addons-20210813200824-393438             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m43s

	  kube-system                 kube-controller-manager-addons-20210813200824-393438    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m43s

	  kube-system                 kube-proxy-tz56r                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m28s

	  kube-system                 kube-scheduler-addons-20210813200824-393438             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m42s

	  kube-system                 snapshot-controller-989f9ddc8-n5hps                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m23s

	  kube-system                 snapshot-controller-989f9ddc8-nbw4s                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m23s

	  kube-system                 storage-provisioner                                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m23s

	  my-etcd                     etcd-operator-85cd4f54cd-z9qkn                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m49s

	  olm                         catalog-operator-75d496484d-x887b                       10m (0%!)(MISSING)      0 (0%!)(MISSING)      80Mi (2%!)(MISSING)        0 (0%!)(MISSING)         8m19s

	  olm                         olm-operator-859c88c96-7j2mx                            10m (0%!)(MISSING)      0 (0%!)(MISSING)      160Mi (4%!)(MISSING)       0 (0%!)(MISSING)         8m19s

	  olm                         operatorhubio-catalog-n7288                             10m (0%!)(MISSING)      0 (0%!)(MISSING)      50Mi (1%!)(MISSING)        0 (0%!)(MISSING)         8m5s

	  olm                         packageserver-6f5dccfdd7-4g764                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m1s

	  olm                         packageserver-6f5dccfdd7-tl766                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                780m (39%!)(MISSING)   0 (0%!)(MISSING)

	  memory             460Mi (11%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasSufficientMemory  8m51s (x6 over 8m51s)  kubelet     Node addons-20210813200824-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m51s (x5 over 8m51s)  kubelet     Node addons-20210813200824-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m51s (x5 over 8m51s)  kubelet     Node addons-20210813200824-393438 status is now: NodeHasSufficientPID

	  Normal  Starting                 8m36s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  8m35s                  kubelet     Node addons-20210813200824-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m35s                  kubelet     Node addons-20210813200824-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m35s                  kubelet     Node addons-20210813200824-393438 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  8m35s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                8m29s                  kubelet     Node addons-20210813200824-393438 status is now: NodeReady

	  Normal  Starting                 8m27s                  kube-proxy  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [ +15.840037] systemd-fstab-generator[2791]: Ignoring "noauto" for root device

	[ +14.377305] kauditd_printk_skb: 38 callbacks suppressed

	[  +5.575875] kauditd_printk_skb: 89 callbacks suppressed

	[  +5.088237] kauditd_printk_skb: 155 callbacks suppressed

	[  +5.850593] kauditd_printk_skb: 65 callbacks suppressed

	[Aug13 20:10] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.945146] kauditd_printk_skb: 74 callbacks suppressed

	[  +6.958629] kauditd_printk_skb: 20 callbacks suppressed

	[ +13.544389] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.814485] kauditd_printk_skb: 92 callbacks suppressed

	[  +5.918284] kauditd_printk_skb: 8 callbacks suppressed

	[  +0.075357] NFSD: Unable to end grace period: -110

	[  +7.914343] kauditd_printk_skb: 8 callbacks suppressed

	[Aug13 20:11] kauditd_printk_skb: 29 callbacks suppressed

	[ +13.960229] kauditd_printk_skb: 2 callbacks suppressed

	[  +7.262407] kauditd_printk_skb: 44 callbacks suppressed

	[  +5.911360] kauditd_printk_skb: 77 callbacks suppressed

	[  +5.814317] kauditd_printk_skb: 11 callbacks suppressed

	[  +5.273238] kauditd_printk_skb: 119 callbacks suppressed

	[ +14.132068] kauditd_printk_skb: 161 callbacks suppressed

	[Aug13 20:12] kauditd_printk_skb: 20 callbacks suppressed

	[  +5.004601] kauditd_printk_skb: 185 callbacks suppressed

	[ +12.403977] kauditd_printk_skb: 14 callbacks suppressed

	[  +7.833337] kauditd_printk_skb: 5 callbacks suppressed

	[  +5.353883] kauditd_printk_skb: 8 callbacks suppressed

	* 

	* ==> etcd [15845df69373b7ad6d4cc3cd3f5b12ddc44a5ab8399b847bdcd053969ae26098] <==

	* time="2021-08-13T20:12:25Z" level=info msg="Go Version: go1.11.5"

	time="2021-08-13T20:12:25Z" level=info msg="Go OS/Arch: linux/amd64"

	time="2021-08-13T20:12:25Z" level=info msg="etcd-backup-operator Version: 0.9.4"

	time="2021-08-13T20:12:25Z" level=info msg="Git SHA: c8a1c64"

	E0813 20:12:25.766733       1 event.go:259] Could not construct reference to: '&v1.Endpoints{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"etcd-backup-operator", GenerateName:"", Namespace:"my-etcd", SelfLink:"", UID:"790bab1f-bf38-4483-83bd-150235be981e", ResourceVersion:"1956", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63764482345, loc:(*time.Location)(0x25824c0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"control-plane.alpha.kubernetes.io/leader":"{\"holderIdentity\":\"etcd-operator-85cd4f54cd-z9qkn\",\"leaseDurationSeconds\":15,\"acquireTime\":\"2021-08-13T20:12:25Z\",\"renewTime\":\"2021-08-13T20:12:25Z\",\"leaderTransitions\":0}"}, OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Subsets:[]v1.EndpointSubset(nil)}' due to: 'selfLink was empty, can't make reference'. Wil

l not report event: 'Normal' 'LeaderElection' 'etcd-operator-85cd4f54cd-z9qkn became leader'

	time="2021-08-13T20:12:25Z" level=info msg="starting backup controller" pkg=controller

	* 

	* ==> etcd [3736ef34faf5386a1e54e3256b7fdc0a58ab296ebc66ed3629bd1b10ce81f0bf] <==

	* time="2021-08-13T20:12:25Z" level=info msg="etcd-operator Version: 0.9.4"

	time="2021-08-13T20:12:25Z" level=info msg="Git SHA: c8a1c64"

	time="2021-08-13T20:12:25Z" level=info msg="Go Version: go1.11.5"

	time="2021-08-13T20:12:25Z" level=info msg="Go OS/Arch: linux/amd64"

	E0813 20:12:25.414913       1 event.go:259] Could not construct reference to: '&v1.Endpoints{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"etcd-operator", GenerateName:"", Namespace:"my-etcd", SelfLink:"", UID:"330771f8-27e9-43f2-8913-846d0859293a", ResourceVersion:"1947", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63764482345, loc:(*time.Location)(0x20d4640)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"control-plane.alpha.kubernetes.io/leader":"{\"holderIdentity\":\"etcd-operator-85cd4f54cd-z9qkn\",\"leaseDurationSeconds\":15,\"acquireTime\":\"2021-08-13T20:12:25Z\",\"renewTime\":\"2021-08-13T20:12:25Z\",\"leaderTransitions\":0}"}, OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Subsets:[]v1.EndpointSubset(nil)}' due to: 'selfLink was empty, can't make reference'. Will not r

eport event: 'Normal' 'LeaderElection' 'etcd-operator-85cd4f54cd-z9qkn became leader'

	* 

	* ==> etcd [3e737acc6b66b5f48dd56d5484e762f91f4aa2386a2e689a93f86173adde6ed2] <==

	* time="2021-08-13T20:12:26Z" level=info msg="Go Version: go1.11.5"

	time="2021-08-13T20:12:26Z" level=info msg="Go OS/Arch: linux/amd64"

	time="2021-08-13T20:12:26Z" level=info msg="etcd-restore-operator Version: 0.9.4"

	time="2021-08-13T20:12:26Z" level=info msg="Git SHA: c8a1c64"

	E0813 20:12:26.113544       1 event.go:259] Could not construct reference to: '&v1.Endpoints{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"etcd-restore-operator", GenerateName:"", Namespace:"my-etcd", SelfLink:"", UID:"18033575-98bd-4cfa-a23b-cb8cb07d498b", ResourceVersion:"1962", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63764482346, loc:(*time.Location)(0x24e11a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"etcd-operator-alm-owned"}, Annotations:map[string]string{"endpoints.kubernetes.io/last-change-trigger-time":"2021-08-13T20:12:26Z", "control-plane.alpha.kubernetes.io/leader":"{\"holderIdentity\":\"etcd-operator-85cd4f54cd-z9qkn\",\"leaseDurationSeconds\":15,\"acquireTime\":\"2021-08-13T20:12:26Z\",\"renewTime\":\"2021-08-13T20:12:26Z\",\"leaderTransitions\":1}"}, OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), Cl

usterName:""}, Subsets:[]v1.EndpointSubset(nil)}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Normal' 'LeaderElection' 'etcd-operator-85cd4f54cd-z9qkn became leader'

	time="2021-08-13T20:12:26Z" level=info msg="listening on 0.0.0.0:19999"

	time="2021-08-13T20:12:26Z" level=info msg="starting restore controller" pkg=controller

	* 

	* ==> etcd [ca4b86da42333083c13c8317a477a1b13911234b4a729275a6fe2c4afbf09af4] <==

	* 2021-08-13 20:14:03.876456 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:14:13.877412 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:14:23.875804 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:14:33.876103 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:14:43.876710 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:14:53.885385 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:03.877069 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:13.876340 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:23.876841 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:33.876886 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:43.876142 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:15:53.879903 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:03.876324 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:13.876664 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:23.877179 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:33.876423 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:43.875906 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:16:53.877747 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:03.876488 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:13.875435 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:23.875659 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:33.875256 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:43.876794 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:17:53.883472 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:18:03.876664 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:18:06 up 9 min,  0 users,  load average: 1.47, 2.18, 1.51

	Linux addons-20210813200824-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [fc458818370dc36d2cccfda8758af47c043373d26b4cc16525419748168a0a1c] <==

	* I0813 20:12:31.156561       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:13:12.526436       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:13:12.526948       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:13:12.527521       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:13:52.415614       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:13:52.416465       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:13:52.416946       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:14:35.215603       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:14:35.215688       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:14:35.215698       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:15:10.329817       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:15:10.330053       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:15:10.330073       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:15:44.229123       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:15:44.229410       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:15:44.229448       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:16:18.432539       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:16:18.432662       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:16:18.432673       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:16:51.765221       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:16:51.765613       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:16:51.765647       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:17:31.110463       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:17:31.110639       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:17:31.110661       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	* 

	* ==> kube-controller-manager [0836c7b4d30b423ab16ed6becfc6c861bc1246dfba02c69a81579587af215677] <==

	* I0813 20:11:18.483323       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth-certs-create" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: gcp-auth-certs-create-dp22s"

	I0813 20:11:18.547063       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set gcp-auth-5954cc4898 to 1"

	I0813 20:11:18.597081       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth-5954cc4898" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: gcp-auth-5954cc4898-94h24"

	I0813 20:11:18.658329       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: gcp-auth-certs-patch-4mczz"

	I0813 20:11:23.489879       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth-certs-create" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0813 20:11:24.523244       1 event.go:291] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0813 20:11:38.989732       1 event.go:291] "Event occurred" object="default/private-image" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set private-image-7ff9c8c74f to 1"

	I0813 20:11:39.027623       1 event.go:291] "Event occurred" object="default/private-image-7ff9c8c74f" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: private-image-7ff9c8c74f-qcb6d"

	I0813 20:11:54.163355       1 event.go:291] "Event occurred" object="default/private-image-eu" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set private-image-eu-5956d58f9f to 1"

	I0813 20:11:54.523076       1 event.go:291] "Event occurred" object="default/private-image-eu-5956d58f9f" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: private-image-eu-5956d58f9f-85ktb"

	I0813 20:12:03.023678       1 event.go:291] "Event occurred" object="default/hpvc" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"

	I0813 20:12:04.414459       1 reconciler.go:295] attacherDetacher.AttachVolume started for volume "pvc-6bc352b4-44e1-415a-a380-b3e5e2507bd9" (UniqueName: "kubernetes.io/csi/hostpath.csi.k8s.io^b98a4bed-fc72-11eb-8157-de3776579278") from node "addons-20210813200824-393438" 

	I0813 20:12:04.995346       1 operation_generator.go:368] AttachVolume.Attach succeeded for volume "pvc-6bc352b4-44e1-415a-a380-b3e5e2507bd9" (UniqueName: "kubernetes.io/csi/hostpath.csi.k8s.io^b98a4bed-fc72-11eb-8157-de3776579278") from node "addons-20210813200824-393438" 

	I0813 20:12:04.995844       1 event.go:291] "Event occurred" object="default/task-pv-pod" kind="Pod" apiVersion="v1" type="Normal" reason="SuccessfulAttachVolume" message="AttachVolume.Attach succeeded for volume \"pvc-6bc352b4-44e1-415a-a380-b3e5e2507bd9\" "

	I0813 20:12:17.965158       1 event.go:291] "Event occurred" object="my-etcd/etcd-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set etcd-operator-85cd4f54cd to 1"

	I0813 20:12:17.989278       1 event.go:291] "Event occurred" object="my-etcd/etcd-operator-85cd4f54cd" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: etcd-operator-85cd4f54cd-z9qkn"

	I0813 20:12:20.513272       1 namespace_controller.go:185] Namespace has been deleted ingress-nginx

	I0813 20:12:20.837205       1 namespace_controller.go:185] Namespace has been deleted gcp-auth

	I0813 20:12:38.156890       1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for etcdbackups.etcd.database.coreos.com

	I0813 20:12:38.157380       1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for etcdrestores.etcd.database.coreos.com

	I0813 20:12:38.157435       1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for etcdclusters.etcd.database.coreos.com

	I0813 20:12:38.159057       1 shared_informer.go:240] Waiting for caches to sync for resource quota

	I0813 20:12:38.260046       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:12:38.949312       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I0813 20:12:38.949633       1 shared_informer.go:247] Caches are synced for garbage collector 

	* 

	* ==> kube-proxy [87c6001e81327236e3ac4335bec94bad35287656d27afbac8a4e47224446822b] <==

	* I0813 20:09:39.479546       1 node.go:172] Successfully retrieved node IP: 192.168.39.71

	I0813 20:09:39.479847       1 server_others.go:140] Detected node IP 192.168.39.71

	W0813 20:09:39.480044       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:09:39.575235       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:09:39.575273       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:09:39.575286       1 server_others.go:212] Using iptables Proxier.

	I0813 20:09:39.576045       1 server.go:643] Version: v1.21.3

	I0813 20:09:39.576716       1 config.go:315] Starting service config controller

	I0813 20:09:39.576730       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:09:39.576747       1 config.go:224] Starting endpoint slice config controller

	I0813 20:09:39.576752       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:09:39.583144       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:09:39.586714       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:09:39.677809       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:09:39.677942       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [b6934d633e20754740756e6423c40bf719144c193b1691c2a927017825d7d6a5] <==

	* I0813 20:09:21.886559       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:09:21.886571       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:09:21.893411       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:09:21.894713       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:09:21.894764       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:21.895236       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:21.895439       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:09:21.895575       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:21.895623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:09:21.895766       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:09:21.895901       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:09:21.895944       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:09:21.896071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:09:21.895103       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:09:21.895145       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:09:21.895196       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:22.715238       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:22.799228       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:09:22.833904       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:09:22.850190       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:09:22.894784       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:09:22.958099       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:23.227407       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:09:23.305482       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0813 20:09:25.687261       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:08:36 UTC, end at Fri 2021-08-13 20:18:06 UTC. --

	Aug 13 20:15:10 addons-20210813200824-393438 kubelet[2802]: I0813 20:15:10.621302    2802 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:15:10 addons-20210813200824-393438 kubelet[2802]: I0813 20:15:10.621494    2802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

	Aug 13 20:15:11 addons-20210813200824-393438 kubelet[2802]: I0813 20:15:11.125805    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/nginx" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:15:40 addons-20210813200824-393438 kubelet[2802]: I0813 20:15:40.125462    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/private-image-7ff9c8c74f-qcb6d" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:15:42 addons-20210813200824-393438 kubelet[2802]: I0813 20:15:42.126461    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/private-image-eu-5956d58f9f-85ktb" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:16:14 addons-20210813200824-393438 kubelet[2802]: E0813 20:16:14.456920    2802 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/host-path/ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e-gcp-creds podName:ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e nodeName:}" failed. No retries permitted until 2021-08-13 20:18:16.456186362 +0000 UTC m=+531.102339319 (durationBeforeRetry 2m2s). Error: "MountVolume.SetUp failed for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e-gcp-creds\") pod \"task-pv-pod\" (UID: \"ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e\") : hostPath type check failed: /var/lib/minikube/google_application_credentials.json is not a file"

	Aug 13 20:16:19 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:19.125265    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/nginx" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:16:20 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:20.125614    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:16:24 addons-20210813200824-393438 kubelet[2802]: E0813 20:16:24.127154    2802 kubelet.go:1701] "Unable to attach or mount volumes for pod; skipping pod" err="unmounted volumes=[gcp-creds], unattached volumes=[task-pv-storage kube-api-access-945zl gcp-creds]: timed out waiting for the condition" pod="default/task-pv-pod"

	Aug 13 20:16:24 addons-20210813200824-393438 kubelet[2802]: E0813 20:16:24.127315    2802 pod_workers.go:190] "Error syncing pod, skipping" err="unmounted volumes=[gcp-creds], unattached volumes=[task-pv-storage kube-api-access-945zl gcp-creds]: timed out waiting for the condition" pod="default/task-pv-pod" podUID=ac97e3e5-6a9e-42fc-98f9-0b7b5e76359e

	Aug 13 20:16:26 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:26.011398    2802 clientconn.go:106] parsed scheme: ""

	Aug 13 20:16:26 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:26.011503    2802 clientconn.go:106] scheme "" not registered, fallback to default scheme

	Aug 13 20:16:26 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:26.011577    2802 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/lib/kubelet/plugins/csi-hostpath/csi.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:16:26 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:26.011596    2802 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:16:26 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:26.011905    2802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

	Aug 13 20:16:41 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:41.126058    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/private-image-7ff9c8c74f-qcb6d" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:16:49 addons-20210813200824-393438 kubelet[2802]: I0813 20:16:49.124859    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/private-image-eu-5956d58f9f-85ktb" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:17:21 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:21.126194    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/nginx" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:17:35 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:35.129673    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"

	Aug 13 20:17:38 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:38.362444    2802 clientconn.go:106] parsed scheme: ""

	Aug 13 20:17:38 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:38.362557    2802 clientconn.go:106] scheme "" not registered, fallback to default scheme

	Aug 13 20:17:38 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:38.362659    2802 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/var/lib/kubelet/plugins/csi-hostpath/csi.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:17:38 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:38.362676    2802 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:17:38 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:38.362768    2802 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

	Aug 13 20:17:58 addons-20210813200824-393438 kubelet[2802]: I0813 20:17:58.125390    2802 kubelet_pods.go:895] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/private-image-7ff9c8c74f-qcb6d" secret="" err="secret \"gcp-auth\" not found"

	* 

	* ==> storage-provisioner [cbfa35fa4df5f4debb8503bab761817df8d0a280ccec78a5b66c7d251259222d] <==

	* I0813 20:09:57.287759       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:09:57.381590       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:09:57.397355       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0813 20:09:57.426687       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:09:57.427057       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-20210813200824-393438_bfa9f873-ba0f-4b6f-a73a-cea46ed8c526!

	I0813 20:09:57.430506       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"49d9e163-3b40-4ba7-9ec0-9c0877ba53ab", APIVersion:"v1", ResourceVersion:"888", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-20210813200824-393438_bfa9f873-ba0f-4b6f-a73a-cea46ed8c526 became leader

	I0813 20:09:57.538473       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-20210813200824-393438_bfa9f873-ba0f-4b6f-a73a-cea46ed8c526!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-20210813200824-393438 -n addons-20210813200824-393438

helpers_test.go:262: (dbg) Run:  kubectl --context addons-20210813200824-393438 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: task-pv-pod

helpers_test.go:273: ======> post-mortem[TestAddons/parallel/CSI]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context addons-20210813200824-393438 describe pod task-pv-pod

helpers_test.go:281: (dbg) kubectl --context addons-20210813200824-393438 describe pod task-pv-pod:

-- stdout --

	Name:         task-pv-pod

	Namespace:    default

	Priority:     0

	Node:         addons-20210813200824-393438/192.168.39.71

	Start Time:   Fri, 13 Aug 2021 20:12:04 +0000

	Labels:       app=task-pv-pod

	Annotations:  <none>

	Status:       Pending

	IP:           

	IPs:          <none>

	Containers:

	  task-pv-container:

	    Container ID:   

	    Image:          nginx

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ContainerCreating

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      k8s-minikube

	      GCP_PROJECT:                     k8s-minikube

	      GCLOUD_PROJECT:                  k8s-minikube

	      GOOGLE_CLOUD_PROJECT:            k8s-minikube

	      CLOUDSDK_CORE_PROJECT:           k8s-minikube

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /usr/share/nginx/html from task-pv-storage (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-945zl (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  task-pv-storage:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  hpvc

	    ReadOnly:   false

	  kube-api-access-945zl:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason                   Age                   From                                      Message

	  ----     ------                   ----                  ----                                      -------

	  Normal   Scheduled                6m2s                  default-scheduler                         Successfully assigned default/task-pv-pod to addons-20210813200824-393438

	  Normal   SuccessfulAttachVolume   6m2s                  attachdetach-controller                   AttachVolume.Attach succeeded for volume "pvc-6bc352b4-44e1-415a-a380-b3e5e2507bd9"

	  Warning  VolumeConditionAbnormal  6m1s (x10 over 6m2s)  csi-pv-monitor-agent-hostpath.csi.k8s.io  The volume isn't mounted

	  Warning  FailedMount              3m59s                 kubelet                                   Unable to attach or mount volumes: unmounted volumes=[gcp-creds], unattached volumes=[kube-api-access-945zl gcp-creds task-pv-storage]: timed out waiting for the condition

	  Warning  FailedMount              112s (x10 over 6m2s)  kubelet                                   MountVolume.SetUp failed for volume "gcp-creds" : hostPath type check failed: /var/lib/minikube/google_application_credentials.json is not a file

	  Warning  FailedMount              102s                  kubelet                                   Unable to attach or mount volumes: unmounted volumes=[gcp-creds], unattached volumes=[task-pv-storage kube-api-access-945zl gcp-creds]: timed out waiting for the condition

	  Normal   VolumeConditionNormal    62s (x41 over 5m2s)   csi-pv-monitor-agent-hostpath.csi.k8s.io  The Volume returns to the healthy state

-- /stdout --

helpers_test.go:284: <<< TestAddons/parallel/CSI FAILED: end of post-mortem logs <<<

helpers_test.go:285: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/CSI (364.17s)

=== RUN   TestPause/serial/Pause

pause_test.go:107: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5

pause_test.go:107: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5: exit status 80 (2.077906139s)

-- stdout --

	* Pausing node pause-20210813205520-393438 ... 

-- /stdout --

** stderr ** 

	I0813 20:58:28.883779  429631 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:58:28.890051  429631 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:28.890067  429631 out.go:311] Setting ErrFile to fd 2...

	I0813 20:58:28.890072  429631 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:28.890170  429631 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:58:28.890357  429631 out.go:305] Setting JSON to false

	I0813 20:58:28.890380  429631 mustload.go:65] Loading cluster: pause-20210813205520-393438

	I0813 20:58:28.890702  429631 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:58:28.891070  429631 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:28.891112  429631 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:28.929795  429631 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:38423

	I0813 20:58:28.930685  429631 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:28.931399  429631 main.go:130] libmachine: Using API Version  1

	I0813 20:58:28.931424  429631 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:28.931799  429631 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:28.931979  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:58:28.935640  429631 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:58:28.936128  429631 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:28.936174  429631 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:28.949846  429631 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:41471

	I0813 20:58:28.950261  429631 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:28.950798  429631 main.go:130] libmachine: Using API Version  1

	I0813 20:58:28.950823  429631 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:28.951190  429631 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:28.951432  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:28.952237  429631 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=

true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso https://github.com/kubernetes/minikube/releases/download/v1.22.0-1628622362-12032/minikube-v1.22.0-1628622362-12032.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.22.0-1628622362-12032.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu

gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20210813205520-393438 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I0813 20:58:28.954906  429631 out.go:177] * Pausing node pause-20210813205520-393438 ... 

	I0813 20:58:28.954950  429631 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:58:28.955372  429631 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:28.955420  429631 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:28.966603  429631 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:35503

	I0813 20:58:28.967036  429631 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:28.967611  429631 main.go:130] libmachine: Using API Version  1

	I0813 20:58:28.967634  429631 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:28.968131  429631 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:28.968326  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:28.969078  429631 ssh_runner.go:149] Run: systemctl --version

	I0813 20:58:28.969110  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:28.975246  429631 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:28.975698  429631 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:28.975725  429631 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:28.975875  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:28.976039  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:28.976222  429631 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:28.976373  429631 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:29.074314  429631 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:58:29.087625  429631 pause.go:50] kubelet running: true

	I0813 20:58:29.087708  429631 ssh_runner.go:149] Run: sudo systemctl disable --now kubelet

	I0813 20:58:29.405482  429631 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I0813 20:58:29.405618  429631 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I0813 20:58:29.582949  429631 cri.go:76] found id: "33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81"

	I0813 20:58:29.582985  429631 cri.go:76] found id: "b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d"

	I0813 20:58:29.582992  429631 cri.go:76] found id: "afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5"

	I0813 20:58:29.582998  429631 cri.go:76] found id: "57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849"

	I0813 20:58:29.583032  429631 cri.go:76] found id: "1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c"

	I0813 20:58:29.583045  429631 cri.go:76] found id: "0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5"

	I0813 20:58:29.583051  429631 cri.go:76] found id: "1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c"

	I0813 20:58:29.583058  429631 cri.go:76] found id: "1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62"

	I0813 20:58:29.583067  429631 cri.go:76] found id: "63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0"

	I0813 20:58:29.583080  429631 cri.go:76] found id: "698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889"

	I0813 20:58:29.583088  429631 cri.go:76] found id: "df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418"

	I0813 20:58:29.583115  429631 cri.go:76] found id: "68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8"

	I0813 20:58:29.583134  429631 cri.go:76] found id: "11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016"

	I0813 20:58:29.583145  429631 cri.go:76] found id: ""

	I0813 20:58:29.583195  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:58:29.629154  429631 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","pid":4658,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5/rootfs","created":"2021-08-13T20:58:12.412888441Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","pid":4590,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","rootfs":"/run/containerd/io.containerd.runtime

.v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c/rootfs","created":"2021-08-13T20:58:11.057580039Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","pid":4542,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c/rootfs","created":"2021-08-13T20:58:10.472076836Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872"},"owner":"root"

},{"ociVersion":"1.0.2-dev","id":"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81","pid":4945,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81/rootfs","created":"2021-08-13T20:58:26.807760136Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","pid":4374,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb63287541

9302e95acc029a319006f332461cf7cf/rootfs","created":"2021-08-13T20:58:09.064644692Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20210813205520-393438_86a000e5c08d32d80b2fd4e89cd34dd1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","pid":4269,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94/rootfs","created":"2021-08-13T20:58:08.848304205Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","io.kubernetes.cri.sandbox-log-dire

ctory":"/var/log/pods/kube-system_kube-proxy-mlf5c_c0812228-e936-4bfa-9fbb-a4d0707f2a63"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","pid":4244,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872/rootfs","created":"2021-08-13T20:58:08.637074413Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20210813205520-393438_469cea0375ae276925a50e4dde7e4ace"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","pid":4624,"status":"running","bundle":"/run/containerd/io.cont

ainerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849/rootfs","created":"2021-08-13T20:58:11.449040242Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","pid":4909,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a/rootfs","created":"2021-08-13T20:58:26.026296621Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.

cri.sandbox-id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_99920d7c-bb8d-4c65-bf44-b56f23a40e53"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","pid":4366,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22/rootfs","created":"2021-08-13T20:58:09.044079666Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20210813205520-393438_36ca0d21ef43020c8f018e62049ff15f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"afabb5f1

3041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","pid":4682,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5/rootfs","created":"2021-08-13T20:58:11.953431943Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d","pid":4701,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d/rootfs","created":"2021-

08-13T20:58:12.144003819Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","pid":4318,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1/rootfs","created":"2021-08-13T20:58:08.900909328Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20210813205520-393438_81d9f8c777d9fb26ff8b7d9c93d26d5e"},"owner":"root"},{"ociVers

ion":"1.0.2-dev","id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","pid":4486,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682/rootfs","created":"2021-08-13T20:58:09.821697744Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-558bd4d5db-jzmnb_ea00ae4c-f4d9-414c-8762-6314a96c8a06"},"owner":"root"}]

	I0813 20:58:29.629365  429631 cri.go:113] list returned 14 containers

	I0813 20:58:29.629382  429631 cri.go:116] container: {ID:0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 Status:running}

	I0813 20:58:29.629393  429631 cri.go:116] container: {ID:1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c Status:running}

	I0813 20:58:29.629398  429631 cri.go:116] container: {ID:1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c Status:running}

	I0813 20:58:29.629407  429631 cri.go:116] container: {ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81 Status:running}

	I0813 20:58:29.629417  429631 cri.go:116] container: {ID:3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf Status:running}

	I0813 20:58:29.629425  429631 cri.go:118] skipping 3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf - not in ps

	I0813 20:58:29.629435  429631 cri.go:116] container: {ID:47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 Status:running}

	I0813 20:58:29.629447  429631 cri.go:118] skipping 47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 - not in ps

	I0813 20:58:29.629456  429631 cri.go:116] container: {ID:53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 Status:running}

	I0813 20:58:29.629463  429631 cri.go:118] skipping 53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 - not in ps

	I0813 20:58:29.629471  429631 cri.go:116] container: {ID:57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849 Status:running}

	I0813 20:58:29.629476  429631 cri.go:116] container: {ID:76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a Status:running}

	I0813 20:58:29.629484  429631 cri.go:118] skipping 76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a - not in ps

	I0813 20:58:29.629489  429631 cri.go:116] container: {ID:a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 Status:running}

	I0813 20:58:29.629499  429631 cri.go:118] skipping a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 - not in ps

	I0813 20:58:29.629505  429631 cri.go:116] container: {ID:afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5 Status:running}

	I0813 20:58:29.629514  429631 cri.go:116] container: {ID:b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d Status:running}

	I0813 20:58:29.629521  429631 cri.go:116] container: {ID:ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 Status:running}

	I0813 20:58:29.629531  429631 cri.go:118] skipping ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 - not in ps

	I0813 20:58:29.629537  429631 cri.go:116] container: {ID:cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 Status:running}

	I0813 20:58:29.629547  429631 cri.go:118] skipping cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 - not in ps

	I0813 20:58:29.629597  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5

	I0813 20:58:29.658850  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c

	I0813 20:58:29.691721  429631 retry.go:31] will retry after 276.165072ms: runc: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c: Process exited with status 1

	stdout:

	Incorrect Usage.

	NAME:

	   runc pause - pause suspends all processes inside the container

	USAGE:

	   runc pause <container-id>

	Where "<container-id>" is the name for the instance of the container to be

	paused. 

	DESCRIPTION:

	   The pause command suspends all processes in the instance of the container.

	Use runc list to identify instances of containers and their current status.

	stderr:

	time="2021-08-13T20:58:29Z" level=error msg="runc: \"pause\" requires exactly 1 argument(s)"

	I0813 20:58:29.968106  429631 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:58:29.983502  429631 pause.go:50] kubelet running: false

	I0813 20:58:29.983574  429631 ssh_runner.go:149] Run: sudo systemctl disable --now kubelet

	I0813 20:58:30.271170  429631 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I0813 20:58:30.271285  429631 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I0813 20:58:30.447672  429631 cri.go:76] found id: "33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81"

	I0813 20:58:30.447704  429631 cri.go:76] found id: "b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d"

	I0813 20:58:30.447711  429631 cri.go:76] found id: "afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5"

	I0813 20:58:30.447717  429631 cri.go:76] found id: "57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849"

	I0813 20:58:30.447733  429631 cri.go:76] found id: "1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c"

	I0813 20:58:30.447742  429631 cri.go:76] found id: "0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5"

	I0813 20:58:30.447747  429631 cri.go:76] found id: "1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c"

	I0813 20:58:30.447752  429631 cri.go:76] found id: "1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62"

	I0813 20:58:30.447757  429631 cri.go:76] found id: "63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0"

	I0813 20:58:30.447768  429631 cri.go:76] found id: "698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889"

	I0813 20:58:30.447777  429631 cri.go:76] found id: "df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418"

	I0813 20:58:30.447782  429631 cri.go:76] found id: "68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8"

	I0813 20:58:30.447788  429631 cri.go:76] found id: "11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016"

	I0813 20:58:30.447793  429631 cri.go:76] found id: ""

	I0813 20:58:30.447842  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:58:30.511580  429631 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","pid":4658,"status":"paused","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5/rootfs","created":"2021-08-13T20:58:12.412888441Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","pid":4590,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","rootfs":"/run/containerd/io.containerd.runtime.

v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c/rootfs","created":"2021-08-13T20:58:11.057580039Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","pid":4542,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c/rootfs","created":"2021-08-13T20:58:10.472076836Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872"},"owner":"root"}

,{"ociVersion":"1.0.2-dev","id":"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81","pid":4945,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81/rootfs","created":"2021-08-13T20:58:26.807760136Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","pid":4374,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419

302e95acc029a319006f332461cf7cf/rootfs","created":"2021-08-13T20:58:09.064644692Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20210813205520-393438_86a000e5c08d32d80b2fd4e89cd34dd1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","pid":4269,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94/rootfs","created":"2021-08-13T20:58:08.848304205Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","io.kubernetes.cri.sandbox-log-direc

tory":"/var/log/pods/kube-system_kube-proxy-mlf5c_c0812228-e936-4bfa-9fbb-a4d0707f2a63"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","pid":4244,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872/rootfs","created":"2021-08-13T20:58:08.637074413Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20210813205520-393438_469cea0375ae276925a50e4dde7e4ace"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","pid":4624,"status":"running","bundle":"/run/containerd/io.conta

inerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849/rootfs","created":"2021-08-13T20:58:11.449040242Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","pid":4909,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a/rootfs","created":"2021-08-13T20:58:26.026296621Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.c

ri.sandbox-id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_99920d7c-bb8d-4c65-bf44-b56f23a40e53"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","pid":4366,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22/rootfs","created":"2021-08-13T20:58:09.044079666Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20210813205520-393438_36ca0d21ef43020c8f018e62049ff15f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"afabb5f13

041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","pid":4682,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5/rootfs","created":"2021-08-13T20:58:11.953431943Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d","pid":4701,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d/rootfs","created":"2021-0

8-13T20:58:12.144003819Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","pid":4318,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1/rootfs","created":"2021-08-13T20:58:08.900909328Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20210813205520-393438_81d9f8c777d9fb26ff8b7d9c93d26d5e"},"owner":"root"},{"ociVersi

on":"1.0.2-dev","id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","pid":4486,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682/rootfs","created":"2021-08-13T20:58:09.821697744Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-558bd4d5db-jzmnb_ea00ae4c-f4d9-414c-8762-6314a96c8a06"},"owner":"root"}]

	I0813 20:58:30.511870  429631 cri.go:113] list returned 14 containers

	I0813 20:58:30.511892  429631 cri.go:116] container: {ID:0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 Status:paused}

	I0813 20:58:30.511908  429631 cri.go:122] skipping {0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 paused}: state = "paused", want "running"

	I0813 20:58:30.511934  429631 cri.go:116] container: {ID:1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c Status:running}

	I0813 20:58:30.511958  429631 cri.go:116] container: {ID:1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c Status:running}

	I0813 20:58:30.511966  429631 cri.go:116] container: {ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81 Status:running}

	I0813 20:58:30.511974  429631 cri.go:116] container: {ID:3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf Status:running}

	I0813 20:58:30.511986  429631 cri.go:118] skipping 3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf - not in ps

	I0813 20:58:30.511993  429631 cri.go:116] container: {ID:47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 Status:running}

	I0813 20:58:30.512005  429631 cri.go:118] skipping 47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 - not in ps

	I0813 20:58:30.512014  429631 cri.go:116] container: {ID:53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 Status:running}

	I0813 20:58:30.512034  429631 cri.go:118] skipping 53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 - not in ps

	I0813 20:58:30.512042  429631 cri.go:116] container: {ID:57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849 Status:running}

	I0813 20:58:30.512051  429631 cri.go:116] container: {ID:76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a Status:running}

	I0813 20:58:30.512061  429631 cri.go:118] skipping 76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a - not in ps

	I0813 20:58:30.512069  429631 cri.go:116] container: {ID:a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 Status:running}

	I0813 20:58:30.512081  429631 cri.go:118] skipping a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 - not in ps

	I0813 20:58:30.512087  429631 cri.go:116] container: {ID:afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5 Status:running}

	I0813 20:58:30.512105  429631 cri.go:116] container: {ID:b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d Status:running}

	I0813 20:58:30.512116  429631 cri.go:116] container: {ID:ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 Status:running}

	I0813 20:58:30.512124  429631 cri.go:118] skipping ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 - not in ps

	I0813 20:58:30.512130  429631 cri.go:116] container: {ID:cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 Status:running}

	I0813 20:58:30.512137  429631 cri.go:118] skipping cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 - not in ps

	I0813 20:58:30.512210  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c

	I0813 20:58:30.571372  429631 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c 1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c

	I0813 20:58:30.774625  429631 out.go:177] 

	W0813 20:58:30.774867  429631 out.go:242] X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c 1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c: Process exited with status 1

	stdout:

	Incorrect Usage.

	NAME:

	   runc pause - pause suspends all processes inside the container

	USAGE:

	   runc pause <container-id>

	Where "<container-id>" is the name for the instance of the container to be

	paused. 

	DESCRIPTION:

	   The pause command suspends all processes in the instance of the container.

	Use runc list to identify instances of containers and their current status.

	stderr:

	time="2021-08-13T20:58:30Z" level=error msg="runc: \"pause\" requires exactly 1 argument(s)"

	X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c 1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c: Process exited with status 1

	stdout:

	Incorrect Usage.

	NAME:

	   runc pause - pause suspends all processes inside the container

	USAGE:

	   runc pause <container-id>

	Where "<container-id>" is the name for the instance of the container to be

	paused. 

	DESCRIPTION:

	   The pause command suspends all processes in the instance of the container.

	Use runc list to identify instances of containers and their current status.

	stderr:

	time="2021-08-13T20:58:30Z" level=error msg="runc: \"pause\" requires exactly 1 argument(s)"

	W0813 20:58:30.774885  429631 out.go:242] * 

	* 

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	W0813 20:58:30.896245  429631 out.go:242] ╭──────────────────────────────────────────────────────────────────────────────╮

	│                                                                              │

	│    * If the above advice does not help, please let us know:                  │

	│      https://github.com/kubernetes/minikube/issues/new/choose                │

	│                                                                              │

	│    * Please attach the following file to the GitHub issue:                   │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                              │

	╰──────────────────────────────────────────────────────────────────────────────╯

	╭──────────────────────────────────────────────────────────────────────────────╮

	│                                                                              │

	│    * If the above advice does not help, please let us know:                  │

	│      https://github.com/kubernetes/minikube/issues/new/choose                │

	│                                                                              │

	│    * Please attach the following file to the GitHub issue:                   │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                              │

	╰──────────────────────────────────────────────────────────────────────────────╯

	I0813 20:58:30.897645  429631 out.go:177] 

** /stderr **

pause_test.go:109: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (334.272994ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25

=== CONT  TestPause/serial/Pause

helpers_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25: exit status 110 (11.921235551s)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                             Args                             |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|--------------------------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | multinode-20210813202658-393438 cp testdata/cp-test.txt      | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:31 UTC | Fri, 13 Aug 2021 20:30:31 UTC |

	|         | multinode-20210813202658-393438-m03:/home/docker/cp-test.txt |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438                              | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:31 UTC | Fri, 13 Aug 2021 20:30:31 UTC |

	|         | ssh -n                                                       |                                          |         |         |                               |                               |

	|         | multinode-20210813202658-393438-m03                          |                                          |         |         |                               |                               |

	|         | sudo cat /home/docker/cp-test.txt                            |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438                              | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:31 UTC | Fri, 13 Aug 2021 20:30:33 UTC |

	|         | node stop m03                                                |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438                              | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:34 UTC | Fri, 13 Aug 2021 20:31:44 UTC |

	|         | node start m03                                               |                                          |         |         |                               |                               |

	|         | --alsologtostderr                                            |                                          |         |         |                               |                               |

	| stop    | -p                                                           | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:31:45 UTC | Fri, 13 Aug 2021 20:34:51 UTC |

	|         | multinode-20210813202658-393438                              |                                          |         |         |                               |                               |

	| start   | -p                                                           | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:34:51 UTC | Fri, 13 Aug 2021 20:40:57 UTC |

	|         | multinode-20210813202658-393438                              |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                                             |                                          |         |         |                               |                               |

	|         | --alsologtostderr                                            |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438                              | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:40:58 UTC | Fri, 13 Aug 2021 20:40:59 UTC |

	|         | node delete m03                                              |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438                              | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:41:00 UTC | Fri, 13 Aug 2021 20:44:04 UTC |

	|         | stop                                                         |                                          |         |         |                               |                               |

	| start   | -p                                                           | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:44:04 UTC | Fri, 13 Aug 2021 20:48:01 UTC |

	|         | multinode-20210813202658-393438                              |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                                             |                                          |         |         |                               |                               |

	|         | --alsologtostderr --driver=kvm2                              |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd                              |                                          |         |         |                               |                               |

	| start   | -p                                                           | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:48:01 UTC | Fri, 13 Aug 2021 20:49:01 UTC |

	|         | multinode-20210813202658-393438-m03                          |                                          |         |         |                               |                               |

	|         | --driver=kvm2                                                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	| delete  | -p                                                           | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:02 UTC | Fri, 13 Aug 2021 20:49:03 UTC |

	|         | multinode-20210813202658-393438-m03                          |                                          |         |         |                               |                               |

	| delete  | -p                                                           | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:03 UTC | Fri, 13 Aug 2021 20:49:05 UTC |

	|         | multinode-20210813202658-393438                              |                                          |         |         |                               |                               |

	| start   | -p                                                           | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:50:38 UTC | Fri, 13 Aug 2021 20:52:46 UTC |

	|         | test-preload-20210813205038-393438                           |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                              |                                          |         |         |                               |                               |

	|         | --wait=true --preload=false                                  |                                          |         |         |                               |                               |

	|         | --driver=kvm2                                                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0                                 |                                          |         |         |                               |                               |

	| ssh     | -p                                                           | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:47 UTC | Fri, 13 Aug 2021 20:52:48 UTC |

	|         | test-preload-20210813205038-393438                           |                                          |         |         |                               |                               |

	|         | -- sudo crictl pull busybox                                  |                                          |         |         |                               |                               |

	| start   | -p                                                           | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:48 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438                           |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                              |                                          |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=kvm2                               |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd                              |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3                                 |                                          |         |         |                               |                               |

	| ssh     | -p                                                           | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438                           |                                          |         |         |                               |                               |

	|         | -- sudo crictl image ls                                      |                                          |         |         |                               |                               |

	| delete  | -p                                                           | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:41 UTC |

	|         | test-preload-20210813205038-393438                           |                                          |         |         |                               |                               |

	| start   | -p                                                           | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:41 UTC | Fri, 13 Aug 2021 20:54:41 UTC |

	|         | scheduled-stop-20210813205341-393438                         |                                          |         |         |                               |                               |

	|         | --memory=2048 --driver=kvm2                                  |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	| stop    | -p                                                           | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:42 UTC | Fri, 13 Aug 2021 20:54:42 UTC |

	|         | scheduled-stop-20210813205341-393438                         |                                          |         |         |                               |                               |

	|         | --cancel-scheduled                                           |                                          |         |         |                               |                               |

	| stop    | -p                                                           | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:55 UTC | Fri, 13 Aug 2021 20:55:02 UTC |

	|         | scheduled-stop-20210813205341-393438                         |                                          |         |         |                               |                               |

	|         | --schedule 5s                                                |                                          |         |         |                               |                               |

	| delete  | -p                                                           | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:20 UTC | Fri, 13 Aug 2021 20:55:20 UTC |

	|         | scheduled-stop-20210813205341-393438                         |                                          |         |         |                               |                               |

	| start   | -p                                                           | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:33 UTC |

	|         | offline-containerd-20210813205520-393438                     |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048                         |                                          |         |         |                               |                               |

	|         | --wait=true --driver=kvm2                                    |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	| delete  | -p                                                           | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:33 UTC | Fri, 13 Aug 2021 20:57:35 UTC |

	|         | offline-containerd-20210813205520-393438                     |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438                               | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:54 UTC |

	|         | --memory=2048                                                |                                          |         |         |                               |                               |

	|         | --install-addons=false                                       |                                          |         |         |                               |                               |

	|         | --wait=all --driver=kvm2                                     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438                               | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:54 UTC | Fri, 13 Aug 2021 20:58:28 UTC |

	|         | --alsologtostderr                                            |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                                           |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd                               |                                          |         |         |                               |                               |

	|---------|--------------------------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:57:54

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:57:54.227836  429419 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:57:54.227958  429419 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:57:54.227968  429419 out.go:311] Setting ErrFile to fd 2...

	I0813 20:57:54.227974  429419 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:57:54.228135  429419 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:57:54.228531  429419 out.go:305] Setting JSON to false

	I0813 20:57:54.278874  429419 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":6037,"bootTime":1628882238,"procs":186,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:57:54.279049  429419 start.go:121] virtualization: kvm guest

	I0813 20:57:54.283675  429419 out.go:177] * [pause-20210813205520-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:57:54.283809  429419 notify.go:169] Checking for updates...

	I0813 20:57:54.285488  429419 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:57:54.287249  429419 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:57:54.289101  429419 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:57:54.290719  429419 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:57:54.291123  429419 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:57:54.291704  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:57:54.291758  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:57:54.312879  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:35945

	I0813 20:57:54.316190  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:57:54.316884  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:57:54.316904  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:57:54.317328  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:57:54.317559  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:57:54.317721  429419 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:57:54.318327  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:57:54.318368  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:57:54.334038  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37183

	I0813 20:57:54.334991  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:57:54.335595  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:57:54.335617  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:57:54.336044  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:57:54.336259  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:57:54.374924  429419 out.go:177] * Using the kvm2 driver based on existing profile

	I0813 20:57:54.374951  429419 start.go:278] selected driver: kvm2

	I0813 20:57:54.374958  429419 start.go:751] validating driver "kvm2" against &{Name:pause-20210813205520-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernetes

Version:v1.21.3 ClusterName:pause-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.151 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:57:54.375068  429419 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:57:54.375866  429419 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:57:54.376016  429419 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:57:54.389481  429419 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:57:54.390376  429419 cni.go:93] Creating CNI manager for ""

	I0813 20:57:54.390391  429419 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:57:54.390401  429419 start_flags.go:277] config:

	{Name:pause-20210813205520-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:pause-20210813205520-393438 Namespace:default APIS

erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.151 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:57:54.390533  429419 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:57:50.331497  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:50.331936  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | unable to find current IP address of domain kubernetes-upgrade-20210813205735-393438 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:50.331970  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | I0813 20:57:50.331883  429234 retry.go:31] will retry after 2.346016261s: waiting for machine to come up

	I0813 20:57:52.679005  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:52.679491  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | unable to find current IP address of domain kubernetes-upgrade-20210813205735-393438 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:52.679525  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | I0813 20:57:52.679444  429234 retry.go:31] will retry after 3.36678925s: waiting for machine to come up

	I0813 20:57:57.243154  428960 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.1.0: (5.652778978s)

	I0813 20:57:57.243198  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 from cache

	I0813 20:57:57.243216  428960 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: (5.65286892s)

	I0813 20:57:57.243256  428960 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0: (5.652939109s)

	I0813 20:57:57.243263  428960 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-scheduler_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.20.0': No such file or directory

	I0813 20:57:57.243289  428960 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-proxy_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.20.0': No such file or directory

	I0813 20:57:57.243346  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 --> /var/lib/minikube/images/kube-proxy_v1.20.0 (49545216 bytes)

	I0813 20:57:57.243294  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 --> /var/lib/minikube/images/kube-scheduler_v1.20.0 (14016512 bytes)

	I0813 20:57:57.243225  428960 containerd.go:280] Loading image: /var/lib/minikube/images/etcd_3.4.13-0

	I0813 20:57:57.243396  428960 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0: (5.653073476s)

	I0813 20:57:57.243436  428960 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0

	I0813 20:57:57.243467  428960 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: (5.653059507s)

	I0813 20:57:57.243438  428960 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-controller-manager_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.20.0': No such file or directory

	I0813 20:57:57.243492  428960 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-apiserver_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.20.0': No such file or directory

	I0813 20:57:57.243494  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 --> /var/lib/minikube/images/kube-controller-manager_v1.20.0 (29364736 bytes)

	I0813 20:57:57.243504  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 --> /var/lib/minikube/images/kube-apiserver_v1.20.0 (30411776 bytes)

	I0813 20:57:54.392920  429419 out.go:177] * Starting control plane node pause-20210813205520-393438 in cluster pause-20210813205520-393438

	I0813 20:57:54.392962  429419 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:57:54.393008  429419 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4

	I0813 20:57:54.393038  429419 cache.go:56] Caching tarball of preloaded images

	I0813 20:57:54.393233  429419 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:57:54.393257  429419 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on containerd

	I0813 20:57:54.393491  429419 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/config.json ...

	I0813 20:57:54.393699  429419 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:57:54.393726  429419 start.go:313] acquiring machines lock for pause-20210813205520-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:57:56.047749  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:56.048296  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | unable to find current IP address of domain kubernetes-upgrade-20210813205735-393438 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:56.048330  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | I0813 20:57:56.048218  429234 retry.go:31] will retry after 3.11822781s: waiting for machine to come up

	I0813 20:57:59.169571  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:59.170032  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Found IP for machine: 192.168.39.75

	I0813 20:57:59.170055  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has current primary IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:57:59.170065  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserving static IP address...

	I0813 20:57:59.170394  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | unable to find host DHCP lease matching {name: "kubernetes-upgrade-20210813205735-393438", mac: "52:54:00:50:ef:93", ip: "192.168.39.75"} in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.353104  429197 start.go:317] acquired machines lock for "running-upgrade-20210813205520-393438" in 20.583632989s

	I0813 20:58:01.353144  429197 start.go:93] Skipping create...Using existing machine configuration

	I0813 20:58:01.353155  429197 fix.go:55] fixHost starting: 

	I0813 20:58:01.353619  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:01.353675  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:01.367986  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:34035

	I0813 20:58:01.368354  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:01.368854  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:58:01.368880  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:01.369265  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:01.369438  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:01.369539  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetState

	I0813 20:58:01.372492  429197 fix.go:108] recreateIfNeeded on running-upgrade-20210813205520-393438: state=Running err=<nil>

	W0813 20:58:01.372512  429197 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 20:58:02.369671  429419 start.go:317] acquired machines lock for "pause-20210813205520-393438" in 7.975923017s

	I0813 20:58:02.369767  429419 start.go:93] Skipping create...Using existing machine configuration

	I0813 20:58:02.369778  429419 fix.go:55] fixHost starting: 

	I0813 20:58:02.370221  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:02.370267  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:02.389834  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:39355

	I0813 20:58:02.390322  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:02.391005  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:02.391038  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:02.391560  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:02.391790  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.392267  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:58:02.395467  429419 fix.go:108] recreateIfNeeded on pause-20210813205520-393438: state=Running err=<nil>

	W0813 20:58:02.395488  429419 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 20:58:00.620023  428960 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0: (3.376559727s)

	I0813 20:58:00.620053  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 from cache

	I0813 20:58:00.620081  428960 containerd.go:280] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:00.620122  428960 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:01.071409  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 from cache

	I0813 20:58:01.071438  428960 containerd.go:280] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I0813 20:58:01.071478  428960 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I0813 20:58:01.801397  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 from cache

	I0813 20:58:01.801444  428960 containerd.go:280] Loading image: /var/lib/minikube/images/kube-apiserver_v1.20.0

	I0813 20:58:01.801499  428960 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0

	I0813 20:58:02.633263  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 from cache

	I0813 20:58:02.633311  428960 containerd.go:280] Loading image: /var/lib/minikube/images/kube-proxy_v1.20.0

	I0813 20:58:02.633369  428960 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0

	I0813 20:58:02.512977  429419 out.go:177] * Updating the running kvm2 "pause-20210813205520-393438" VM ...

	I0813 20:58:02.513037  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.513323  429419 machine.go:88] provisioning docker machine ...

	I0813 20:58:02.513356  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.513579  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:02.513769  429419 buildroot.go:166] provisioning hostname "pause-20210813205520-393438"

	I0813 20:58:02.513794  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:02.513948  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.519437  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.519941  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:02.519978  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.520179  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.520364  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.520484  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.520593  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.520727  429419 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:02.520932  429419 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.61.151 22 <nil> <nil>}

	I0813 20:58:02.520947  429419 main.go:130] libmachine: About to run SSH command:

	sudo hostname pause-20210813205520-393438 && echo "pause-20210813205520-393438" | sudo tee /etc/hostname

	I0813 20:58:02.664206  429419 main.go:130] libmachine: SSH cmd err, output: <nil>: pause-20210813205520-393438

	I0813 20:58:02.664232  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.669771  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.670174  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:02.670214  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.670299  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.670487  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.670613  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.670768  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.670969  429419 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:02.671142  429419 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.61.151 22 <nil> <nil>}

	I0813 20:58:02.671175  429419 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\spause-20210813205520-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 pause-20210813205520-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 pause-20210813205520-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:58:02.801199  429419 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:58:02.801235  429419 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:58:02.801292  429419 buildroot.go:174] setting up certificates

	I0813 20:58:02.801305  429419 provision.go:83] configureAuth start

	I0813 20:58:02.801322  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:02.801576  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetIP

	I0813 20:58:02.807528  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.807983  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:02.808024  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.808279  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.812654  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.813006  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:02.813049  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.813153  429419 provision.go:138] copyHostCerts

	I0813 20:58:02.813221  429419 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 20:58:02.813233  429419 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 20:58:02.813292  429419 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:58:02.813459  429419 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 20:58:02.813472  429419 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 20:58:02.813500  429419 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:58:02.813565  429419 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 20:58:02.813578  429419 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 20:58:02.813598  429419 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:58:02.813648  429419 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.pause-20210813205520-393438 san=[192.168.61.151 192.168.61.151 localhost 127.0.0.1 minikube pause-20210813205520-393438]

	I0813 20:58:02.895323  429419 provision.go:172] copyRemoteCerts

	I0813 20:58:02.895392  429419 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:58:02.895422  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.900956  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.901361  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:02.901398  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:02.901520  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.901707  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.901879  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.902043  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:02.992614  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:58:03.012287  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)

	I0813 20:58:03.039330  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 20:58:03.061251  429419 provision.go:86] duration metric: configureAuth took 259.931214ms

	I0813 20:58:03.061282  429419 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:58:03.061438  429419 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:58:03.061456  429419 machine.go:91] provisioned docker machine in 548.114914ms

	I0813 20:58:03.061465  429419 start.go:267] post-start starting for "pause-20210813205520-393438" (driver="kvm2")

	I0813 20:58:03.061474  429419 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:58:03.061504  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.061845  429419 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:58:03.061884  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:03.067847  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.068220  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:03.068257  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.068447  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:03.068641  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:03.068853  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:03.069085  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:03.159483  429419 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:58:03.166585  429419 info.go:137] Remote host: Buildroot 2020.02.12

	I0813 20:58:03.166611  429419 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:58:03.166684  429419 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:58:03.166788  429419 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> 3934382.pem in /etc/ssl/certs

	I0813 20:58:03.166940  429419 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs

	I0813 20:58:03.175603  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:03.200099  429419 start.go:270] post-start completed in 138.617691ms

	I0813 20:58:03.200144  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.200450  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:03.206510  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.206933  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:03.206965  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.207089  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:03.207291  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:03.207456  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:03.207571  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:03.207724  429419 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:03.207940  429419 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.61.151 22 <nil> <nil>}

	I0813 20:58:03.207956  429419 main.go:130] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0813 20:58:03.332969  429419 main.go:130] libmachine: SSH cmd err, output: <nil>: 1628888283.332928680

	I0813 20:58:03.333004  429419 fix.go:212] guest clock: 1628888283.332928680

	I0813 20:58:03.333015  429419 fix.go:225] Guest: 2021-08-13 20:58:03.33292868 +0000 UTC Remote: 2021-08-13 20:58:03.200426824 +0000 UTC m=+9.038396484 (delta=132.501856ms)

	I0813 20:58:03.333066  429419 fix.go:196] guest clock delta is within tolerance: 132.501856ms

	I0813 20:58:03.333079  429419 fix.go:57] fixHost completed within 963.299889ms

	I0813 20:58:03.333087  429419 start.go:80] releasing machines lock for "pause-20210813205520-393438", held for 963.343148ms

	I0813 20:58:03.333131  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.333414  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetIP

	I0813 20:58:03.339415  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.339852  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:03.339914  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.340067  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.340256  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.340945  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:03.341168  429419 ssh_runner.go:149] Run: systemctl --version

	I0813 20:58:03.341194  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:03.341226  429419 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:58:03.341271  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:03.348033  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.348444  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:03.348474  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.348592  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:03.348817  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:03.348850  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.349023  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:03.349185  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:03.349396  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:03.349425  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:03.349608  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:03.349758  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:03.349937  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:03.350092  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:03.488156  429419 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:58:03.488291  429419 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:03.542272  429419 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:58:03.542308  429419 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:58:03.542387  429419 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:58:03.559727  429419 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:58:03.573052  429419 docker.go:153] disabling docker service ...

	I0813 20:58:03.573110  429419 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:58:03.588513  429419 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:58:03.601081  429419 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:58:03.807642  429419 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:58:04.025905  429419 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:58:04.038186  429419 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:58:04.051431  429419 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuNC4xIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKCglbcGx1Z2lucy4iaW8uY

29udGFpbmVyZC5ncnBjLnYxLmNyaSJdCiAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzXQogICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuY10KICAgICAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuYy5vcHRpb25zXQogICAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkXQogICAgICBzbmFwc2hvdHRlciA9ICJvdmVybGF5ZnMiCiAgICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkLmRlZmF1bHRfcnVudGltZV0KICAgICAgICBydW50aW1lX3R5cGUgPSAiaW8uY29udGFpbmVyZC5ydW5jLnYyIgogICAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZC51bnRydXN0ZWRfd29ya2xvYWRfcnVudGltZV0KICAgICAgICBydW50aW1lX3R5cGUgPSAiIgogICAgICAgIHJ1bnRpbWVfZW5naW5lID0gIiIKICAgICAgICBydW50aW1lX3Jvb3QgPSAiIgogICAgW3BsdWdpbnMuY3JpLmNuaV0KICAgICAgYmluX2RpciA9ICIvb3B0L2NuaS9iaW4iCiAgICAgIGNvbmZfZGlyID0gIi9ldGMvY25pL25ldC5kI

gogICAgICBjb25mX3RlbXBsYXRlID0gIiIKICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeV0KICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnNdCiAgICAgICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5Lm1pcnJvcnMuImRvY2tlci5pbyJdCiAgICAgICAgICBlbmRwb2ludCA9IFsiaHR0cHM6Ly9yZWdpc3RyeS0xLmRvY2tlci5pbyJdCiAgICAgICAgW3BsdWdpbnMuZGlmZi1zZXJ2aWNlXQogICAgZGVmYXVsdCA9IFsid2Fsa2luZyJdCiAgW3BsdWdpbnMuc2NoZWR1bGVyXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:58:04.067863  429419 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:58:04.074416  429419 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:58:04.080465  429419 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:58:01.375107  429197 out.go:177] * Updating the running kvm2 "running-upgrade-20210813205520-393438" VM ...

	I0813 20:58:01.375136  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:01.375318  429197 machine.go:88] provisioning docker machine ...

	I0813 20:58:01.375339  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:01.375482  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:01.375970  429197 buildroot.go:166] provisioning hostname "running-upgrade-20210813205520-393438"

	I0813 20:58:01.375991  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:01.376164  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:01.382332  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.382796  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:01.382820  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.383186  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:01.383367  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.383498  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.383635  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:01.383755  429197 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:01.383938  429197 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.72.177 22 <nil> <nil>}

	I0813 20:58:01.383955  429197 main.go:130] libmachine: About to run SSH command:

	sudo hostname running-upgrade-20210813205520-393438 && echo "running-upgrade-20210813205520-393438" | sudo tee /etc/hostname

	I0813 20:58:01.526891  429197 main.go:130] libmachine: SSH cmd err, output: <nil>: running-upgrade-20210813205520-393438

	I0813 20:58:01.526928  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:01.532560  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.532948  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:01.532985  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.533195  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:01.533405  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.533557  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.533700  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:01.533893  429197 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:01.534068  429197 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.72.177 22 <nil> <nil>}

	I0813 20:58:01.534095  429197 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\srunning-upgrade-20210813205520-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-20210813205520-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 running-upgrade-20210813205520-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:58:01.660693  429197 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:58:01.660786  429197 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:58:01.660823  429197 buildroot.go:174] setting up certificates

	I0813 20:58:01.660859  429197 provision.go:83] configureAuth start

	I0813 20:58:01.660884  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetMachineName

	I0813 20:58:01.661212  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetIP

	I0813 20:58:01.666792  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.667132  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:01.667161  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.667299  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:01.672142  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.672449  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:01.672484  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.672617  429197 provision.go:138] copyHostCerts

	I0813 20:58:01.672676  429197 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 20:58:01.672687  429197 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 20:58:01.672733  429197 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:58:01.672819  429197 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 20:58:01.672828  429197 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 20:58:01.672845  429197 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:58:01.672891  429197 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 20:58:01.672898  429197 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 20:58:01.672914  429197 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:58:01.672953  429197 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-20210813205520-393438 san=[192.168.72.177 192.168.72.177 localhost 127.0.0.1 minikube running-upgrade-20210813205520-393438]

	I0813 20:58:01.955669  429197 provision.go:172] copyRemoteCerts

	I0813 20:58:01.955750  429197 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:58:01.955797  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:01.961518  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.961848  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:01.961879  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:01.962073  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:01.962296  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.962470  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:01.962590  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:02.054935  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)

	I0813 20:58:02.074997  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0813 20:58:02.092406  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:58:02.110099  429197 provision.go:86] duration metric: configureAuth took 449.221105ms

	I0813 20:58:02.110122  429197 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:58:02.110320  429197 config.go:177] Loaded profile config "running-upgrade-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I0813 20:58:02.110338  429197 machine.go:91] provisioned docker machine in 735.009311ms

	I0813 20:58:02.110348  429197 start.go:267] post-start starting for "running-upgrade-20210813205520-393438" (driver="kvm2")

	I0813 20:58:02.110356  429197 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:58:02.110388  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.110765  429197 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:58:02.110807  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.116435  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.116808  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:02.116836  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.117005  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.117198  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.117362  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.117528  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:02.206660  429197 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:58:02.211471  429197 info.go:137] Remote host: Buildroot 2020.02.8

	I0813 20:58:02.211494  429197 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:58:02.211553  429197 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:58:02.211677  429197 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> 3934382.pem in /etc/ssl/certs

	I0813 20:58:02.211807  429197 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs

	I0813 20:58:02.219467  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:02.239252  429197 start.go:270] post-start completed in 128.890177ms

	I0813 20:58:02.239303  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.239590  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.245021  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.245400  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:02.245432  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.245580  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.245771  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.245946  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.246095  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.246247  429197 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:02.246390  429197 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.72.177 22 <nil> <nil>}

	I0813 20:58:02.246400  429197 main.go:130] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0813 20:58:02.369458  429197 main.go:130] libmachine: SSH cmd err, output: <nil>: 1628888282.369620172

	I0813 20:58:02.369485  429197 fix.go:212] guest clock: 1628888282.369620172

	I0813 20:58:02.369495  429197 fix.go:225] Guest: 2021-08-13 20:58:02.369620172 +0000 UTC Remote: 2021-08-13 20:58:02.239570477 +0000 UTC m=+21.705648010 (delta=130.049695ms)

	I0813 20:58:02.369521  429197 fix.go:196] guest clock delta is within tolerance: 130.049695ms

	I0813 20:58:02.369534  429197 fix.go:57] fixHost completed within 1.016379041s

	I0813 20:58:02.369545  429197 start.go:80] releasing machines lock for "running-upgrade-20210813205520-393438", held for 1.016415951s

	I0813 20:58:02.369590  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.369919  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetIP

	I0813 20:58:02.376274  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.376670  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:02.376702  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.376996  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.377181  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.377763  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:58:02.378018  429197 ssh_runner.go:149] Run: systemctl --version

	I0813 20:58:02.378051  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.378116  429197 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:58:02.378199  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:02.390031  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.391575  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:02.391628  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.391649  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.391676  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:02.391696  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.391720  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:02.391742  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:02.391785  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.391820  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:02.391976  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.392015  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:02.392165  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:02.392434  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:02.482957  429197 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I0813 20:58:02.483058  429197 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:58:02.528626  429197 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:58:02.542800  429197 docker.go:153] disabling docker service ...

	I0813 20:58:02.542854  429197 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:58:02.556787  429197 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:58:02.569356  429197 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:58:02.791696  429197 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:58:03.034623  429197 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:58:03.050969  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:58:03.070245  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuMiIKICAgIHN0YXRzX2NvbGxlY3RfcGVyaW9kID0gMTAKICAgIGVuYWJsZV90bHNfc3RyZWFtaW5nID0gZmFsc2UKICAgIG1heF9jb250YWluZXJfbG9nX2xpbmVfc2l6ZSA9IDE2Mzg0CgoJW3BsdWdpbnMuImlvLmNvb

nRhaW5lcmQuZ3JwYy52MS5jcmkiXQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZF0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lc10KICAgICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzLnJ1bmNdCiAgICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzLnJ1bmMub3B0aW9uc10KICAgICAgICAgICAgICBTeXN0ZW1kQ2dyb3VwID0gZmFsc2UKCiAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZF0KICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgIFtwbHVnaW5zLmNyaS5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQuZCIKI

CAgICAgY29uZl90ZW1wbGF0ZSA9ICIiCiAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnldCiAgICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeS5taXJyb3JzXQogICAgICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeS5taXJyb3JzLiJkb2NrZXIuaW8iXQogICAgICAgICAgZW5kcG9pbnQgPSBbImh0dHBzOi8vcmVnaXN0cnktMS5kb2NrZXIuaW8iXQogICAgICAgIFtwbHVnaW5zLmRpZmYtc2VydmljZV0KICAgIGRlZmF1bHQgPSBbIndhbGtpbmciXQogIFtwbHVnaW5zLnNjaGVkdWxlcl0KICAgIHBhdXNlX3RocmVzaG9sZCA9IDAuMDIKICAgIGRlbGV0aW9uX3RocmVzaG9sZCA9IDAKICAgIG11dGF0aW9uX3RocmVzaG9sZCA9IDEwMAogICAgc2NoZWR1bGVfZGVsYXkgPSAiMHMiCiAgICBzdGFydHVwX2RlbGF5ID0gIjEwMG1zIgo=" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:58:03.089065  429197 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:58:03.096355  429197 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:58:03.103961  429197 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:58:03.305775  429197 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:58:03.376047  429197 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:58:03.376196  429197 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:03.386544  429197 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:58:04.492070  429197 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:04.498525  429197 start.go:413] Will wait 60s for crictl version

	I0813 20:58:04.498600  429197 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:58:04.532736  429197 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.3

	RuntimeApiVersion:  v1alpha2

	I0813 20:58:04.532802  429197 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:04.586917  429197 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:00.213385  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserved static IP address: 192.168.39.75

	I0813 20:58:00.221280  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Waiting for SSH to be available...

	I0813 20:58:00.221299  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Getting to WaitForSSH function...

	I0813 20:58:00.221336  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.221380  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:minikube Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.221409  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.221428  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH client type: external

	I0813 20:58:00.221459  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH private key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa (-rw-------)

	I0813 20:58:00.221511  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.75 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0813 20:58:00.221528  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | About to run SSH command:

	I0813 20:58:00.221539  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | exit 0

	I0813 20:58:00.363262  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | SSH cmd err, output: <nil>: 

	I0813 20:58:00.363799  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) KVM machine creation complete!

	I0813 20:58:00.363855  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetConfigRaw

	I0813 20:58:00.364524  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:00.364740  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:00.364883  429159 main.go:130] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0813 20:58:00.364914  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:58:00.368233  429159 main.go:130] libmachine: Detecting operating system of created instance...

	I0813 20:58:00.368251  429159 main.go:130] libmachine: Waiting for SSH to be available...

	I0813 20:58:00.368260  429159 main.go:130] libmachine: Getting to WaitForSSH function...

	I0813 20:58:00.368270  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:00.373705  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.374033  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.374063  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.374182  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:00.374390  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.374560  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.374723  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:00.374924  429159 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:00.375090  429159 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:58:00.375104  429159 main.go:130] libmachine: About to run SSH command:

	exit 0

	I0813 20:58:00.502332  429159 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:58:00.502360  429159 main.go:130] libmachine: Detecting the provisioner...

	I0813 20:58:00.502374  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:00.508141  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.508493  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.508523  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.508695  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:00.508912  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.509059  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.509239  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:00.509398  429159 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:00.509564  429159 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:58:00.509579  429159 main.go:130] libmachine: About to run SSH command:

	cat /etc/os-release

	I0813 20:58:00.635654  429159 main.go:130] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2020.02.12

	ID=buildroot

	VERSION_ID=2020.02.12

	PRETTY_NAME="Buildroot 2020.02.12"

	I0813 20:58:00.635727  429159 main.go:130] libmachine: found compatible host: buildroot

	I0813 20:58:00.635742  429159 main.go:130] libmachine: Provisioning with buildroot...

	I0813 20:58:00.635760  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:58:00.636036  429159 buildroot.go:166] provisioning hostname "kubernetes-upgrade-20210813205735-393438"

	I0813 20:58:00.636067  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:58:00.636269  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:00.641594  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.641942  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.641973  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.642121  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:00.642308  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.642483  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.642657  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:00.642857  429159 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:00.643031  429159 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:58:00.643053  429159 main.go:130] libmachine: About to run SSH command:

	sudo hostname kubernetes-upgrade-20210813205735-393438 && echo "kubernetes-upgrade-20210813205735-393438" | sudo tee /etc/hostname

	I0813 20:58:00.778472  429159 main.go:130] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.778498  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:00.783660  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.784012  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.784067  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.784209  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:00.784381  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.784543  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:00.784694  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:00.784870  429159 main.go:130] libmachine: Using SSH client type: native

	I0813 20:58:00.785075  429159 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:58:00.785109  429159 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\skubernetes-upgrade-20210813205735-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20210813205735-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 kubernetes-upgrade-20210813205735-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:58:00.913703  429159 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:58:00.913743  429159 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:58:00.913787  429159 buildroot.go:174] setting up certificates

	I0813 20:58:00.913800  429159 provision.go:83] configureAuth start

	I0813 20:58:00.913823  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:58:00.914103  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:58:00.919932  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.920411  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.920456  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.920581  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:00.925818  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.926126  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:00.926166  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:00.926324  429159 provision.go:138] copyHostCerts

	I0813 20:58:00.926406  429159 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 20:58:00.926432  429159 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 20:58:00.926476  429159 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:58:00.926634  429159 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 20:58:00.926646  429159 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 20:58:00.926684  429159 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:58:00.926764  429159 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 20:58:00.926776  429159 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 20:58:00.926800  429159 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:58:00.926879  429159 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-20210813205735-393438 san=[192.168.39.75 192.168.39.75 localhost 127.0.0.1 minikube kubernetes-upgrade-20210813205735-393438]

	I0813 20:58:01.059804  429159 provision.go:172] copyRemoteCerts

	I0813 20:58:01.059876  429159 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:58:01.059907  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:01.065200  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.065563  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.065602  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.065739  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:01.065882  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.066028  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:01.066171  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:01.159049  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1289 bytes)

	I0813 20:58:01.176032  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0813 20:58:01.195526  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:58:01.213070  429159 provision.go:86] duration metric: configureAuth took 299.254875ms

	I0813 20:58:01.213100  429159 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:58:01.213276  429159 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:58:01.213305  429159 main.go:130] libmachine: Checking connection to Docker...

	I0813 20:58:01.213329  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetURL

	I0813 20:58:01.216389  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using libvirt version 3000000

	I0813 20:58:01.221577  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.221955  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.221990  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.222171  429159 main.go:130] libmachine: Docker is up and running!

	I0813 20:58:01.222207  429159 main.go:130] libmachine: Reticulating splines...

	I0813 20:58:01.222214  429159 client.go:171] LocalClient.Create took 19.667289897s

	I0813 20:58:01.222233  429159 start.go:168] duration metric: libmachine.API.Create for "kubernetes-upgrade-20210813205735-393438" took 19.667394425s

	I0813 20:58:01.222244  429159 start.go:267] post-start starting for "kubernetes-upgrade-20210813205735-393438" (driver="kvm2")

	I0813 20:58:01.222248  429159 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:58:01.222272  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:01.222498  429159 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:58:01.222523  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:01.227009  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.227359  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.227390  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.227487  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:01.227646  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.227808  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:01.227952  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:01.315152  429159 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:58:01.319951  429159 info.go:137] Remote host: Buildroot 2020.02.12

	I0813 20:58:01.319978  429159 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:58:01.320038  429159 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:58:01.320144  429159 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> 3934382.pem in /etc/ssl/certs

	I0813 20:58:01.320263  429159 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs

	I0813 20:58:01.327417  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:01.345758  429159 start.go:270] post-start completed in 123.501719ms

	I0813 20:58:01.345816  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetConfigRaw

	I0813 20:58:01.346427  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:58:01.352086  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.352465  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.352501  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.352797  429159 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/config.json ...

	I0813 20:58:01.352984  429159 start.go:129] duration metric: createHost completed in 19.817325773s

	I0813 20:58:01.353000  429159 start.go:80] releasing machines lock for "kubernetes-upgrade-20210813205735-393438", held for 19.817557489s

	I0813 20:58:01.353048  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:01.353264  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:58:01.358297  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.358676  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.358709  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.358858  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:01.358994  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:01.359456  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:01.359693  429159 ssh_runner.go:149] Run: systemctl --version

	I0813 20:58:01.359726  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:01.359737  429159 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:58:01.359784  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:01.365673  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.365889  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.365918  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.366274  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:01.366498  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.366637  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:01.367026  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:01.367707  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.374603  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:01.374638  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:01.374834  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:01.375036  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:01.375217  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:01.375347  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:01.498522  429159 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime containerd

	I0813 20:58:01.498661  429159 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:04.631173  429197 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...

	I0813 20:58:04.631233  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetIP

	I0813 20:58:04.637218  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:04.637588  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:58:04.637614  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:58:04.637880  429197 ssh_runner.go:149] Run: grep 192.168.72.1	host.minikube.internal$ /etc/hosts

	I0813 20:58:04.642486  429197 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:58:04.657473  429197 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I0813 20:58:04.657526  429197 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:04.698149  429197 containerd.go:609] couldn't find preloaded image for "gcr.io/k8s-minikube/storage-provisioner:v5". assuming images are not preloaded.

	I0813 20:58:04.698175  429197 cache_images.go:78] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.20.0 k8s.gcr.io/kube-controller-manager:v1.20.0 k8s.gcr.io/kube-scheduler:v1.20.0 k8s.gcr.io/kube-proxy:v1.20.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.1.0 docker.io/kubernetesui/metrics-scraper:v1.0.4]

	I0813 20:58:04.698259  429197 image.go:133] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.4

	I0813 20:58:04.698296  429197 image.go:133] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0

	I0813 20:58:04.698321  429197 image.go:133] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I0813 20:58:04.698485  429197 image.go:133] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0

	I0813 20:58:04.698534  429197 image.go:133] retrieving image: docker.io/kubernetesui/dashboard:v2.1.0

	I0813 20:58:04.698554  429197 image.go:133] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0

	I0813 20:58:04.698560  429197 image.go:133] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:58:04.698487  429197 image.go:133] retrieving image: k8s.gcr.io/etcd:3.4.13-0

	I0813 20:58:04.698701  429197 image.go:133] retrieving image: k8s.gcr.io/coredns:1.7.0

	I0813 20:58:04.698260  429197 image.go:133] retrieving image: k8s.gcr.io/pause:3.2

	I0813 20:58:04.706868  429197 image.go:175] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist

	I0813 20:58:04.708066  429197 image.go:175] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist

	I0813 20:58:04.715767  429197 image.go:175] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist

	I0813 20:58:04.717334  429197 image.go:171] found k8s.gcr.io/pause:3.2 locally: &{Image:0xc0006405a0}

	I0813 20:58:04.717381  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2 | grep 80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c"

	I0813 20:58:04.726947  429197 image.go:175] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist

	I0813 20:58:05.046743  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0 | grep ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99"

	I0813 20:58:05.047037  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0 | grep 3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899"

	I0813 20:58:05.047294  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0 | grep 10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc"

	I0813 20:58:05.051798  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0 | grep b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080"

	I0813 20:58:05.362144  429197 image.go:171] found gcr.io/k8s-minikube/storage-provisioner:v5 locally: &{Image:0xc0006406c0}

	I0813 20:58:05.362239  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5 | grep 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562"

	I0813 20:58:05.480324  429197 image.go:171] found index.docker.io/kubernetesui/metrics-scraper:v1.0.4 locally: &{Image:0xc0006406c0}

	I0813 20:58:05.480454  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.4 | grep 86262685d9abb35698a4e03ed13f9ded5b97c6c85b466285e4f367e5232eeee4"

	I0813 20:58:07.719819  428960 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0: (5.086420619s)

	I0813 20:58:07.719849  428960 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 from cache

	I0813 20:58:07.719868  428960 cache_images.go:113] Successfully loaded all cached images

	I0813 20:58:07.719874  428960 cache_images.go:82] LoadImages completed in 24.158820123s

	I0813 20:58:07.719929  428960 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:58:07.775783  428960 cni.go:93] Creating CNI manager for ""

	I0813 20:58:07.775816  428960 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:07.775836  428960 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:58:07.775852  428960 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.169 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-20210813205520-393438 NodeName:stopped-upgrade-20210813205520-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.169"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.72.169 CgroupDrive

r:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:58:07.776044  428960 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.72.169

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "stopped-upgrade-20210813205520-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.72.169

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.72.169"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:58:07.776185  428960 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=stopped-upgrade-20210813205520-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.169 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:58:07.776261  428960 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I0813 20:58:07.789939  428960 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:58:07.790015  428960 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:58:07.801822  428960 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (553 bytes)

	I0813 20:58:07.837438  428960 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:58:04.274633  429419 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:58:04.325363  429419 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:58:04.325440  429419 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:04.332343  429419 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:58:05.440950  429419 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:05.454829  429419 retry.go:31] will retry after 2.160763633s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:58:07.616021  429419 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:07.625125  429419 start.go:413] Will wait 60s for crictl version

	I0813 20:58:07.625202  429419 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:58:07.673919  429419 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.9

	RuntimeApiVersion:  v1alpha2

	I0813 20:58:07.673993  429419 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:07.730049  429419 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:07.858538  429419 out.go:177] * Preparing Kubernetes v1.21.3 on containerd 1.4.9 ...

	I0813 20:58:07.858584  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetIP

	I0813 20:58:07.866501  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:07.866897  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:07.866923  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:07.867447  429419 ssh_runner.go:149] Run: grep 192.168.61.1	host.minikube.internal$ /etc/hosts

	I0813 20:58:07.874725  429419 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:58:07.874789  429419 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:07.931997  429419 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:58:07.932024  429419 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:58:07.932086  429419 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:08.014663  429419 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:58:08.014706  429419 cache_images.go:74] Images are preloaded, skipping loading

	I0813 20:58:08.014762  429419 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:58:08.079166  429419 cni.go:93] Creating CNI manager for ""

	I0813 20:58:08.079204  429419 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:08.079216  429419 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:58:08.079231  429419 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.151 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:pause-20210813205520-393438 NodeName:pause-20210813205520-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.151"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.61.151 CgroupDriver:cgroupfs ClientCAF

ile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:58:08.079388  429419 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.61.151

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "pause-20210813205520-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.61.151

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.61.151"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:58:08.079502  429419 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=pause-20210813205520-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.151 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:pause-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:58:08.079563  429419 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 20:58:08.102835  429419 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:58:08.102912  429419 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:58:08.115661  429419 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (543 bytes)

	I0813 20:58:08.157693  429419 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:58:08.203276  429419 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2083 bytes)

	I0813 20:58:08.256934  429419 ssh_runner.go:149] Run: grep 192.168.61.151	control-plane.minikube.internal$ /etc/hosts

	I0813 20:58:08.281875  429419 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438 for IP: 192.168.61.151

	I0813 20:58:08.281938  429419 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:58:08.281956  429419 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:58:08.282022  429419 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/client.key

	I0813 20:58:08.282056  429419 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/apiserver.key.c009ae4a

	I0813 20:58:08.282077  429419 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/proxy-client.key

	I0813 20:58:08.282200  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:58:08.282247  429419 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:58:08.282258  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:58:08.282287  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:58:08.282314  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:58:08.282341  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:58:08.282394  429419 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:08.283807  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:58:08.406838  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:58:08.438798  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:58:08.485422  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 20:58:08.522308  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:58:08.606848  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:58:08.658827  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:58:08.702848  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:58:08.750845  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:58:08.810823  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:58:08.870860  429419 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:58:08.912634  429419 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:58:08.996309  429419 ssh_runner.go:149] Run: openssl version

	I0813 20:58:09.018539  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:58:09.054920  429419 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:58:09.070854  429419 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:58:09.070922  429419 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:58:09.082365  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:58:09.097764  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:58:09.138606  429419 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:58:09.157109  429419 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:58:09.157202  429419 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:58:05.498928  429159 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.000228359s)

	I0813 20:58:05.499055  429159 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.14.0". assuming images are not preloaded.

	I0813 20:58:05.499118  429159 ssh_runner.go:149] Run: which lz4

	I0813 20:58:05.505579  429159 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:58:05.512832  429159 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:58:05.512872  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.14.0-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (898265258 bytes)

	I0813 20:58:05.581788  429197 image.go:171] found k8s.gcr.io/coredns:1.7.0 locally: &{Image:0xc0000d2980}

	I0813 20:58:05.581925  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0 | grep bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16"

	I0813 20:58:07.454995  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2 | grep 80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c": (2.737580589s)

	I0813 20:58:07.455107  429197 cache_images.go:106] "k8s.gcr.io/pause:3.2" needs transfer: "k8s.gcr.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I0813 20:58:07.456143  429197 cri.go:205] Removing image: k8s.gcr.io/pause:3.2

	I0813 20:58:07.466963  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:07.772130  429197 image.go:171] found index.docker.io/kubernetesui/dashboard:v2.1.0 locally: &{Image:0xc000640680}

	I0813 20:58:07.772235  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.1.0 | grep 9a07b5b4bfac07e5cfc27f76c34516a3ad2fdfa3f683f375141fe662ef2e72db"

	I0813 20:58:08.410519  429197 image.go:171] found k8s.gcr.io/etcd:3.4.13-0 locally: &{Image:0xc0000d2a40}

	I0813 20:58:08.410599  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.4.13-0 | grep 0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934"

	I0813 20:58:10.164973  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0 | grep ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99": (5.118182034s)

	I0813 20:58:10.165073  429197 cache_images.go:106] "k8s.gcr.io/kube-apiserver:v1.20.0" needs transfer: "k8s.gcr.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I0813 20:58:10.165112  429197 cri.go:205] Removing image: k8s.gcr.io/kube-apiserver:v1.20.0

	I0813 20:58:10.165197  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:10.165272  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0 | grep 10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc": (5.117959478s)

	I0813 20:58:10.165302  429197 cache_images.go:106] "k8s.gcr.io/kube-proxy:v1.20.0" needs transfer: "k8s.gcr.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I0813 20:58:10.165325  429197 cri.go:205] Removing image: k8s.gcr.io/kube-proxy:v1.20.0

	I0813 20:58:10.165357  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:10.165415  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0 | grep 3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899": (5.118358244s)

	I0813 20:58:10.165442  429197 cache_images.go:106] "k8s.gcr.io/kube-scheduler:v1.20.0" needs transfer: "k8s.gcr.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I0813 20:58:10.165460  429197 cri.go:205] Removing image: k8s.gcr.io/kube-scheduler:v1.20.0

	I0813 20:58:10.165484  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:07.867749  428960 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2093 bytes)

	I0813 20:58:07.895765  428960 ssh_runner.go:149] Run: grep 192.168.72.169	control-plane.minikube.internal$ /etc/hosts

	I0813 20:58:07.914639  428960 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.169	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:58:07.940069  428960 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438 for IP: 192.168.72.169

	I0813 20:58:07.940139  428960 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:58:07.940167  428960 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:58:07.940234  428960 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/client.key

	I0813 20:58:07.940258  428960 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/apiserver.key.8ded931d

	I0813 20:58:07.940293  428960 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/proxy-client.key

	I0813 20:58:07.940424  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:58:07.940479  428960 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:58:07.940493  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:58:07.940541  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:58:07.940586  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:58:07.940620  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:58:07.940732  428960 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:07.942220  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:58:07.979190  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:58:08.030737  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:58:08.085087  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 20:58:08.113205  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:58:08.163194  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:58:08.203218  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:58:08.247912  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:58:08.301867  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:58:08.362606  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:58:08.401477  428960 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:58:08.450876  428960 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:58:08.475119  428960 ssh_runner.go:149] Run: openssl version

	I0813 20:58:08.491389  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:58:08.518021  428960 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:08.529708  428960 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:08.529784  428960 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:08.543572  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:58:08.555638  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:58:08.568265  428960 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:58:08.585294  428960 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:58:08.585359  428960 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:58:08.595321  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:58:08.616903  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:58:08.628011  428960 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:58:08.643503  428960 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:58:08.643563  428960 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:58:08.653144  428960 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:58:08.667269  428960 kubeadm.go:390] StartCluster: {Name:stopped-upgrade-20210813205520-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName

:stopped-upgrade-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.72.169 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:08.667418  428960 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:58:08.667533  428960 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:08.706592  428960 cri.go:76] found id: "011102c3b344c899a5bebec2b9eabbfd5c46ff9d066de5a22f8565286e749eaa"

	I0813 20:58:08.706630  428960 cri.go:76] found id: "42ef351e6138ddb6202d822d4f338b94da8a80a9f5d46559b2b57f8d11823a4d"

	I0813 20:58:08.706637  428960 cri.go:76] found id: "2e70cdbbe555488f2b5d63a97e718a9df9a22b15dbd7819ed90ffac142e83880"

	I0813 20:58:08.706643  428960 cri.go:76] found id: "40d29042a0eae2d33befba63432abca0ed470881fc1c0006ce428d516fd26ac2"

	I0813 20:58:08.706648  428960 cri.go:76] found id: ""

	I0813 20:58:08.706708  428960 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:58:08.734895  428960 cri.go:103] JSON = null

	W0813 20:58:08.735010  428960 kubeadm.go:397] unpause failed: list paused: list returned 0 containers, but ps returned 4

	I0813 20:58:08.735114  428960 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:58:08.751584  428960 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 20:58:08.751605  428960 kubeadm.go:600] restartCluster start

	I0813 20:58:08.751651  428960 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 20:58:08.766823  428960 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:08.768043  428960 kubeconfig.go:117] verify returned: extract IP: "stopped-upgrade-20210813205520-393438" does not appear in /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:08.768402  428960 kubeconfig.go:128] "stopped-upgrade-20210813205520-393438" context is missing from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig - will repair!

	I0813 20:58:08.769329  428960 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:08.770404  428960 kapi.go:59] client config for stopped-upgrade-20210813205520-393438: &rest.Config{Host:"https://192.168.72.169:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/stopped-upgrade-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles

/stopped-upgrade-20210813205520-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:08.772648  428960 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 20:58:08.783734  428960 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml

	+++ /var/tmp/minikube/kubeadm.yaml.new

	@@ -65,4 +65,10 @@

	 apiVersion: kubeproxy.config.k8s.io/v1alpha1

	 kind: KubeProxyConfiguration

	 clusterCIDR: "10.244.0.0/16"

	-metricsBindAddress: 192.168.72.169:10249

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I0813 20:58:08.783755  428960 kubeadm.go:1032] stopping kube-system containers ...

	I0813 20:58:08.783769  428960 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}

	I0813 20:58:08.783834  428960 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:08.828616  428960 cri.go:76] found id: "011102c3b344c899a5bebec2b9eabbfd5c46ff9d066de5a22f8565286e749eaa"

	I0813 20:58:08.828640  428960 cri.go:76] found id: "42ef351e6138ddb6202d822d4f338b94da8a80a9f5d46559b2b57f8d11823a4d"

	I0813 20:58:08.828647  428960 cri.go:76] found id: "2e70cdbbe555488f2b5d63a97e718a9df9a22b15dbd7819ed90ffac142e83880"

	I0813 20:58:08.828653  428960 cri.go:76] found id: "40d29042a0eae2d33befba63432abca0ed470881fc1c0006ce428d516fd26ac2"

	I0813 20:58:08.828687  428960 cri.go:76] found id: ""

	I0813 20:58:08.828695  428960 cri.go:221] Stopping containers: [011102c3b344c899a5bebec2b9eabbfd5c46ff9d066de5a22f8565286e749eaa 42ef351e6138ddb6202d822d4f338b94da8a80a9f5d46559b2b57f8d11823a4d 2e70cdbbe555488f2b5d63a97e718a9df9a22b15dbd7819ed90ffac142e83880 40d29042a0eae2d33befba63432abca0ed470881fc1c0006ce428d516fd26ac2]

	I0813 20:58:08.828790  428960 ssh_runner.go:149] Run: which crictl

	I0813 20:58:08.834796  428960 ssh_runner.go:149] Run: sudo /bin/crictl stop 011102c3b344c899a5bebec2b9eabbfd5c46ff9d066de5a22f8565286e749eaa 42ef351e6138ddb6202d822d4f338b94da8a80a9f5d46559b2b57f8d11823a4d 2e70cdbbe555488f2b5d63a97e718a9df9a22b15dbd7819ed90ffac142e83880 40d29042a0eae2d33befba63432abca0ed470881fc1c0006ce428d516fd26ac2

	I0813 20:58:08.894950  428960 ssh_runner.go:149] Run: sudo systemctl stop kubelet

	I0813 20:58:08.930429  428960 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 20:58:08.954408  428960 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 20:58:08.954474  428960 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:58:08.967245  428960 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 20:58:08.967278  428960 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:58:09.352210  428960 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:58:10.045184  428960 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:58:10.487006  428960 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:58:10.674629  428960 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:58:10.855661  428960 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:58:10.855741  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:11.372138  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:11.872152  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:12.371930  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:09.192420  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:58:09.212212  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:58:09.239365  429419 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:09.257029  429419 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:09.257090  429419 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:09.274861  429419 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:58:09.296691  429419 kubeadm.go:390] StartCluster: {Name:pause-20210813205520-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 Cl

usterName:pause-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.151 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:09.296799  429419 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:58:09.296859  429419 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:09.414812  429419 cri.go:76] found id: "1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62"

	I0813 20:58:09.414841  429419 cri.go:76] found id: "63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0"

	I0813 20:58:09.414848  429419 cri.go:76] found id: "698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889"

	I0813 20:58:09.414854  429419 cri.go:76] found id: "df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418"

	I0813 20:58:09.414858  429419 cri.go:76] found id: "68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8"

	I0813 20:58:09.414864  429419 cri.go:76] found id: "11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016"

	I0813 20:58:09.414869  429419 cri.go:76] found id: ""

	I0813 20:58:09.414918  429419 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:58:09.484312  429419 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","pid":4374,"status":"created","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf/rootfs","created":"2021-08-13T20:58:09.064644692Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20210813205520-393438_86a000e5c08d32d80b2fd4e89cd34dd1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","pid":4269,"status":"created","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976

e702aa5815af3e39eaebbfe81753ef825ae94","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94/rootfs","created":"2021-08-13T20:58:08.848304205Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-mlf5c_c0812228-e936-4bfa-9fbb-a4d0707f2a63"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","pid":4244,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872/rootfs","created":"2021-08-13T20:58:08.637074413Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kuberne

tes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20210813205520-393438_469cea0375ae276925a50e4dde7e4ace"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","pid":4366,"status":"created","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22/rootfs","created":"2021-08-13T20:58:09.044079666Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20210813205520-393438_36ca0d21ef43020c8f018e62049ff15f"},"owner":"root"},{"ociVersion":"1.

0.2-dev","id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","pid":4318,"status":"created","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1/rootfs","created":"2021-08-13T20:58:08.900909328Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20210813205520-393438_81d9f8c777d9fb26ff8b7d9c93d26d5e"},"owner":"root"}]

	I0813 20:58:09.484468  429419 cri.go:113] list returned 5 containers

	I0813 20:58:09.484480  429419 cri.go:116] container: {ID:3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf Status:created}

	I0813 20:58:09.484495  429419 cri.go:118] skipping 3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf - not in ps

	I0813 20:58:09.484502  429419 cri.go:116] container: {ID:47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 Status:created}

	I0813 20:58:09.484509  429419 cri.go:118] skipping 47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 - not in ps

	I0813 20:58:09.484519  429419 cri.go:116] container: {ID:53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 Status:running}

	I0813 20:58:09.484525  429419 cri.go:118] skipping 53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 - not in ps

	I0813 20:58:09.484530  429419 cri.go:116] container: {ID:a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 Status:created}

	I0813 20:58:09.484537  429419 cri.go:118] skipping a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 - not in ps

	I0813 20:58:09.484542  429419 cri.go:116] container: {ID:ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 Status:created}

	I0813 20:58:09.484548  429419 cri.go:118] skipping ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 - not in ps

	I0813 20:58:09.484595  429419 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:58:09.502320  429419 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 20:58:09.502345  429419 kubeadm.go:600] restartCluster start

	I0813 20:58:09.502401  429419 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 20:58:09.516916  429419 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:09.518267  429419 kubeconfig.go:93] found "pause-20210813205520-393438" server: "https://192.168.61.151:8443"

	I0813 20:58:09.519116  429419 kapi.go:59] client config for pause-20210813205520-393438: &rest.Config{Host:"https://192.168.61.151:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-2021081320552

0-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:09.521291  429419 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 20:58:09.539031  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:09.539094  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:09.577747  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:09.778007  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:09.778103  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:09.805252  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:09.978615  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:09.978710  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:10.017795  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:10.178120  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:10.178226  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:10.197283  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:10.378632  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:10.378712  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:10.392453  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:10.578714  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:10.578807  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:10.609275  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:10.778626  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:10.778722  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:10.824727  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:10.977941  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:10.978056  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:11.030490  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:11.178750  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:11.178845  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0813 20:58:11.213643  429419 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:11.377841  429419 api_server.go:164] Checking apiserver status ...

	I0813 20:58:11.377911  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:11.408459  429419 ssh_runner.go:149] Run: sudo egrep ^[0-9]+:freezer: /proc/4590/cgroup

	I0813 20:58:11.437742  429419 api_server.go:180] apiserver freezer: "3:freezer:/kubepods/burstable/pod36ca0d21ef43020c8f018e62049ff15f/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c"

	I0813 20:58:11.437839  429419 ssh_runner.go:149] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/pod36ca0d21ef43020c8f018e62049ff15f/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c/freezer.state

	I0813 20:58:11.458559  429419 api_server.go:202] freezer state: "THAWED"

	I0813 20:58:11.458595  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:11.459507  429419 api_server.go:255] stopped: https://192.168.61.151:8443/healthz: Get "https://192.168.61.151:8443/healthz": dial tcp 192.168.61.151:8443: connect: connection refused

	I0813 20:58:11.459559  429419 retry.go:31] will retry after 270.570007ms: state is "Stopped"

	I0813 20:58:11.731148  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:10.371660  429159 containerd.go:546] Took 4.866115 seconds to copy over tarball

	I0813 20:58:10.371742  429159 ssh_runner.go:149] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0813 20:58:11.294190  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5 | grep 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562": (5.931928251s)

	I0813 20:58:11.294250  429197 cache_images.go:106] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I0813 20:58:11.294286  429197 cri.go:205] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:58:11.294331  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:11.294190  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0 | grep b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080": (6.2423375s)

	I0813 20:58:11.294384  429197 cache_images.go:106] "k8s.gcr.io/kube-controller-manager:v1.20.0" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I0813 20:58:11.294430  429197 cri.go:205] Removing image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I0813 20:58:11.294474  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:11.532112  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.4 | grep 86262685d9abb35698a4e03ed13f9ded5b97c6c85b466285e4f367e5232eeee4": (6.05159775s)

	I0813 20:58:11.532176  429197 cache_images.go:106] "docker.io/kubernetesui/metrics-scraper:v1.0.4" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.4" does not exist at hash "86262685d9abb35698a4e03ed13f9ded5b97c6c85b466285e4f367e5232eeee4" in container runtime

	I0813 20:58:11.532220  429197 cri.go:205] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.4

	I0813 20:58:11.532271  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:11.532387  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0 | grep bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16": (5.950435015s)

	I0813 20:58:11.532418  429197 cache_images.go:106] "k8s.gcr.io/coredns:1.7.0" needs transfer: "k8s.gcr.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime

	I0813 20:58:11.532440  429197 cri.go:205] Removing image: k8s.gcr.io/coredns:1.7.0

	I0813 20:58:11.532467  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:11.532540  429197 ssh_runner.go:189] Completed: which crictl: (4.065553664s)

	I0813 20:58:11.532570  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/pause:3.2

	I0813 20:58:11.732719  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.1.0 | grep 9a07b5b4bfac07e5cfc27f76c34516a3ad2fdfa3f683f375141fe662ef2e72db": (3.960446224s)

	I0813 20:58:11.732792  429197 cache_images.go:106] "docker.io/kubernetesui/dashboard:v2.1.0" needs transfer: "docker.io/kubernetesui/dashboard:v2.1.0" does not exist at hash "9a07b5b4bfac07e5cfc27f76c34516a3ad2fdfa3f683f375141fe662ef2e72db" in container runtime

	I0813 20:58:11.732831  429197 cri.go:205] Removing image: docker.io/kubernetesui/dashboard:v2.1.0

	I0813 20:58:11.732888  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:12.177573  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.4.13-0 | grep 0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934": (3.766948778s)

	I0813 20:58:12.177624  429197 cache_images.go:106] "k8s.gcr.io/etcd:3.4.13-0" needs transfer: "k8s.gcr.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime

	I0813 20:58:12.177658  429197 cri.go:205] Removing image: k8s.gcr.io/etcd:3.4.13-0

	I0813 20:58:12.177665  429197 ssh_runner.go:189] Completed: which crictl: (2.012165766s)

	I0813 20:58:12.177705  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.20.0

	I0813 20:58:12.177708  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:12.177743  429197 ssh_runner.go:189] Completed: which crictl: (2.012535427s)

	I0813 20:58:12.177765  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.20.0

	I0813 20:58:12.177775  429197 ssh_runner.go:189] Completed: which crictl: (2.012407159s)

	I0813 20:58:12.177798  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/kube-proxy:v1.20.0

	I0813 20:58:12.177837  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.20.0

	I0813 20:58:12.177859  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:58:12.177905  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi docker.io/kubernetesui/metrics-scraper:v1.0.4

	I0813 20:58:12.177938  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I0813 20:58:12.178028  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2

	I0813 20:58:12.178104  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/coredns:1.7.0

	I0813 20:58:12.178169  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi docker.io/kubernetesui/dashboard:v2.1.0

	I0813 20:58:12.735766  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0

	I0813 20:58:12.735919  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.1.0

	I0813 20:58:12.736125  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5

	I0813 20:58:12.736181  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I0813 20:58:12.736229  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0

	I0813 20:58:12.736278  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I0813 20:58:12.736344  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0

	I0813 20:58:12.736379  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4

	I0813 20:58:12.736424  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0

	I0813 20:58:12.736429  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.4

	I0813 20:58:12.749370  429197 ssh_runner.go:149] Run: sudo /bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0

	I0813 20:58:12.749474  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0

	I0813 20:58:12.749550  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0

	I0813 20:58:12.749625  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/pause_3.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/pause_3.2': No such file or directory

	I0813 20:58:12.749646  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/pause_3.2 --> /var/lib/minikube/images/pause_3.2 (325632 bytes)

	I0813 20:58:12.749747  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0

	I0813 20:58:12.749816  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0

	I0813 20:58:12.749892  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0

	I0813 20:58:12.749945  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:12.750119  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/dashboard_v2.1.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.1.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.1.0': No such file or directory

	I0813 20:58:12.750142  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 --> /var/lib/minikube/images/dashboard_v2.1.0 (78078976 bytes)

	I0813 20:58:12.769954  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I0813 20:58:12.769986  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (10569216 bytes)

	I0813 20:58:12.770011  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-controller-manager_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.20.0': No such file or directory

	I0813 20:58:12.770044  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 --> /var/lib/minikube/images/kube-controller-manager_v1.20.0 (29364736 bytes)

	I0813 20:58:12.796017  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-proxy_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.20.0': No such file or directory

	I0813 20:58:12.796065  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 --> /var/lib/minikube/images/kube-proxy_v1.20.0 (49545216 bytes)

	I0813 20:58:12.796113  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.4: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.4': No such file or directory

	I0813 20:58:12.796130  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 --> /var/lib/minikube/images/metrics-scraper_v1.0.4 (17437696 bytes)

	I0813 20:58:12.901221  429197 containerd.go:280] Loading image: /var/lib/minikube/images/pause_3.2

	I0813 20:58:12.901287  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2

	I0813 20:58:12.872540  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:15.372139  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:15.872056  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:16.372598  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:16.872667  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:17.372116  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:16.732502  429419 api_server.go:255] stopped: https://192.168.61.151:8443/healthz: Get "https://192.168.61.151:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I0813 20:58:16.732572  429419 retry.go:31] will retry after 302.767842ms: state is "Stopped"

	I0813 20:58:17.035841  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:20.129718  429197 ssh_runner.go:189] Completed: sudo /bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0: (7.380304253s)

	I0813 20:58:20.129750  429197 cache_images.go:276] Loading image from: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0

	I0813 20:58:20.129841  429197 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0

	I0813 20:58:20.129932  429197 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0: (7.380365665s)

	I0813 20:58:20.129955  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/coredns_1.7.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/coredns_1.7.0': No such file or directory

	I0813 20:58:20.129967  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 --> /var/lib/minikube/images/coredns_1.7.0 (16093184 bytes)

	I0813 20:58:20.130035  429197 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: (7.380204148s)

	I0813 20:58:20.130049  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-apiserver_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.20.0': No such file or directory

	I0813 20:58:20.130061  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 --> /var/lib/minikube/images/kube-apiserver_v1.20.0 (30411776 bytes)

	I0813 20:58:20.130116  429197 ssh_runner.go:189] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: (7.380161291s)

	I0813 20:58:20.130130  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/kube-scheduler_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.20.0': No such file or directory

	I0813 20:58:20.130139  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 --> /var/lib/minikube/images/kube-scheduler_v1.20.0 (14016512 bytes)

	I0813 20:58:20.535154  429197 ssh_runner.go:306] existence check for /var/lib/minikube/images/etcd_3.4.13-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/etcd_3.4.13-0': No such file or directory

	I0813 20:58:20.535366  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 --> /var/lib/minikube/images/etcd_3.4.13-0 (98416128 bytes)

	I0813 20:58:20.535285  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2: (7.633975714s)

	I0813 20:58:20.535487  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/pause_3.2 from cache

	I0813 20:58:20.535521  429197 containerd.go:280] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I0813 20:58:20.535567  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5

	I0813 20:58:17.872369  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:18.872811  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:19.372943  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:19.872402  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:20.372393  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:20.872714  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:21.371855  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:21.872551  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:22.372784  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:20.212718  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0813 20:58:20.212769  429419 retry.go:31] will retry after 375.905761ms: https://192.168.61.151:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0813 20:58:20.588942  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:20.606872  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:20.606922  429419 retry.go:31] will retry after 533.892352ms: https://192.168.61.151:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:21.141670  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:21.155734  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:21.156193  429419 retry.go:31] will retry after 477.7945ms: https://192.168.61.151:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:21.634331  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:23.372208  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:23.372258  429419 retry.go:31] will retry after 631.911946ms: https://192.168.61.151:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:58:24.004585  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:24.014746  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 200:

	ok

	I0813 20:58:24.047913  429419 system_pods.go:86] 6 kube-system pods found

	I0813 20:58:24.047950  429419 system_pods.go:89] "coredns-558bd4d5db-jzmnb" [ea00ae4c-f4d9-414c-8762-6314a96c8a06] Running

	I0813 20:58:24.047965  429419 system_pods.go:89] "etcd-pause-20210813205520-393438" [c0f74993-053a-4721-89b9-a9f01c83cb4e] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0813 20:58:24.047978  429419 system_pods.go:89] "kube-apiserver-pause-20210813205520-393438" [1625a41a-5bb8-43ff-b2ca-fc5a2e96907d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 20:58:24.047995  429419 system_pods.go:89] "kube-controller-manager-pause-20210813205520-393438" [203329cf-5319-4902-8b08-c8ce7d0adc7a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 20:58:24.048006  429419 system_pods.go:89] "kube-proxy-mlf5c" [c0812228-e936-4bfa-9fbb-a4d0707f2a63] Running

	I0813 20:58:24.048017  429419 system_pods.go:89] "kube-scheduler-pause-20210813205520-393438" [a931b4e6-b130-4886-a7dc-604f54907b2f] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 20:58:24.049432  429419 api_server.go:139] control plane version: v1.21.3

	I0813 20:58:24.049458  429419 kubeadm.go:594] The running cluster does not require reconfiguration: 192.168.61.151

	I0813 20:58:24.049470  429419 kubeadm.go:647] Taking a shortcut, as the cluster seems to be properly configured

	I0813 20:58:24.049476  429419 kubeadm.go:604] restartCluster took 14.547125024s

	I0813 20:58:24.049482  429419 kubeadm.go:392] StartCluster complete in 14.752806003s

	I0813 20:58:24.049539  429419 settings.go:142] acquiring lock: {Name:mk2e042a75d7d4722d2a29030eed8e43c687ad8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:24.050179  429419 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:24.051401  429419 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:24.052424  429419 kapi.go:59] client config for pause-20210813205520-393438: &rest.Config{Host:"https://192.168.61.151:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-2021081320552

0-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:24.058432  429419 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "pause-20210813205520-393438" rescaled to 1

	I0813 20:58:24.058497  429419 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.61.151 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 20:58:24.058519  429419 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 20:58:24.060612  429419 out.go:177] * Verifying Kubernetes components...

	I0813 20:58:24.058608  429419 addons.go:342] enableAddons start: toEnable=map[], additional=[]

	I0813 20:58:24.060684  429419 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:58:24.058738  429419 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:58:24.060748  429419 addons.go:59] Setting default-storageclass=true in profile "pause-20210813205520-393438"

	I0813 20:58:24.060776  429419 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "pause-20210813205520-393438"

	I0813 20:58:24.060734  429419 addons.go:59] Setting storage-provisioner=true in profile "pause-20210813205520-393438"

	I0813 20:58:24.060887  429419 addons.go:135] Setting addon storage-provisioner=true in "pause-20210813205520-393438"

	W0813 20:58:24.060901  429419 addons.go:147] addon storage-provisioner should already be in state true

	I0813 20:58:24.060933  429419 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:58:24.061265  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:24.061310  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:24.061398  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:24.061470  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:24.086441  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:34281

	I0813 20:58:24.087621  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:35847

	I0813 20:58:24.088228  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:24.088913  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:24.088941  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:24.089353  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:24.089970  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:24.090041  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:24.090242  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:24.090934  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:24.090981  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:24.091580  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:24.091830  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:58:24.101351  429419 kapi.go:59] client config for pause-20210813205520-393438: &rest.Config{Host:"https://192.168.61.151:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/pause-2021081320552

0-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:24.105577  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:41249

	I0813 20:58:24.106125  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:24.106607  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:24.106626  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:24.107299  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:24.107739  429419 addons.go:135] Setting addon default-storageclass=true in "pause-20210813205520-393438"

	W0813 20:58:24.107764  429419 addons.go:147] addon default-storageclass should already be in state true

	I0813 20:58:24.107795  429419 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:58:24.108145  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:24.108189  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:24.108490  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:58:24.112086  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:24.114751  429419 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:58:24.114860  429419 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:58:24.114874  429419 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 20:58:24.114893  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:24.122761  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:24.122790  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:24.122822  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:24.122871  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:24.123050  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:24.123128  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:33157

	I0813 20:58:24.123685  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:24.124250  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:24.124274  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:24.124712  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:24.125207  429419 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:24.125241  429419 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:24.126884  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:24.127059  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:24.137574  429419 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:44189

	I0813 20:58:24.138079  429419 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:24.138644  429419 main.go:130] libmachine: Using API Version  1

	I0813 20:58:24.138683  429419 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:24.139150  429419 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:24.139337  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:58:24.143020  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:58:24.143234  429419 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 20:58:24.143255  429419 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 20:58:24.143277  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:58:24.149505  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:24.150180  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:58:24.150206  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:58:24.150377  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:58:24.154837  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:58:24.155021  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:58:24.155158  429419 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:58:20.770874  429159 ssh_runner.go:189] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (10.399100695s)

	I0813 20:58:20.770907  429159 containerd.go:553] Took 10.399210 seconds t extract the tarball

	I0813 20:58:20.770920  429159 ssh_runner.go:100] rm: /preloaded.tar.lz4

	I0813 20:58:20.852683  429159 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:58:21.024685  429159 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:58:21.098779  429159 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:58:21.187863  429159 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:58:21.208917  429159 docker.go:153] disabling docker service ...

	I0813 20:58:21.208987  429159 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:58:21.227986  429159 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:58:21.245738  429159 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:58:21.450215  429159 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:58:21.637278  429159 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:58:21.650630  429159 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:58:21.667831  429159 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuMSIKICAgIHN0YXRzX2NvbGxlY3RfcGVyaW9kID0gMTAKICAgIGVuYWJsZV90bHNfc3RyZWFtaW5nID0gZmFsc2UKICAgIG1heF9jb250YWluZXJfbG9nX2xpbmVfc2l6ZSA9IDE2Mzg0CgoJW3BsdWdpbnMuImlvLmNvb

nRhaW5lcmQuZ3JwYy52MS5jcmkiXQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZF0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lc10KICAgICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzLnJ1bmNdCiAgICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzLnJ1bmMub3B0aW9uc10KICAgICAgICAgICAgICBTeXN0ZW1kQ2dyb3VwID0gZmFsc2UKCiAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZF0KICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy5jcmkuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgIFtwbHVnaW5zLmNyaS5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQuZCIKI

CAgICAgY29uZl90ZW1wbGF0ZSA9ICIiCiAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnldCiAgICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeS5taXJyb3JzXQogICAgICAgIFtwbHVnaW5zLmNyaS5yZWdpc3RyeS5taXJyb3JzLiJkb2NrZXIuaW8iXQogICAgICAgICAgZW5kcG9pbnQgPSBbImh0dHBzOi8vcmVnaXN0cnktMS5kb2NrZXIuaW8iXQogICAgICAgIFtwbHVnaW5zLmRpZmYtc2VydmljZV0KICAgIGRlZmF1bHQgPSBbIndhbGtpbmciXQogIFtwbHVnaW5zLnNjaGVkdWxlcl0KICAgIHBhdXNlX3RocmVzaG9sZCA9IDAuMDIKICAgIGRlbGV0aW9uX3RocmVzaG9sZCA9IDAKICAgIG11dGF0aW9uX3RocmVzaG9sZCA9IDEwMAogICAgc2NoZWR1bGVfZGVsYXkgPSAiMHMiCiAgICBzdGFydHVwX2RlbGF5ID0gIjEwMG1zIgo=" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:58:21.682737  429159 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:58:21.689792  429159 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0813 20:58:21.689855  429159 ssh_runner.go:149] Run: sudo modprobe br_netfilter

	I0813 20:58:21.704659  429159 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:58:21.711245  429159 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:58:21.847163  429159 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:58:23.377368  429159 ssh_runner.go:189] Completed: sudo systemctl restart containerd: (1.530163338s)

	I0813 20:58:23.377402  429159 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:58:23.377461  429159 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:23.385715  429159 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:58:24.490807  429159 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:58:24.499589  429159 start.go:413] Will wait 60s for crictl version

	I0813 20:58:24.499656  429159 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:58:24.554180  429159 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.9

	RuntimeApiVersion:  v1alpha2

	I0813 20:58:24.562233  429159 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:24.610748  429159 ssh_runner.go:149] Run: containerd --version

	I0813 20:58:24.696341  429159 out.go:177] * Preparing Kubernetes v1.14.0 on containerd 1.4.9 ...

	I0813 20:58:24.696402  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:58:24.703026  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:24.703446  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:24.703475  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:24.703837  429159 ssh_runner.go:149] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0813 20:58:24.710213  429159 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:58:24.726760  429159 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime containerd

	I0813 20:58:24.726836  429159 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:24.773810  429159 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:58:24.773841  429159 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:58:24.773896  429159 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:58:24.826947  429159 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:58:24.826975  429159 cache_images.go:74] Images are preloaded, skipping loading

	I0813 20:58:24.827042  429159 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:58:24.871237  429159 cni.go:93] Creating CNI manager for ""

	I0813 20:58:24.871271  429159 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:24.871293  429159 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:58:24.871310  429159 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.75 APIServerPort:8443 KubernetesVersion:v1.14.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-20210813205735-393438 NodeName:kubernetes-upgrade-20210813205735-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.75"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.39.75 CgroupDr

iver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:58:24.871473  429159 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta1

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.75

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "kubernetes-upgrade-20210813205735-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.75

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta1

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.75"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: kubernetes-upgrade-20210813205735-393438

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.39.75:2381

	kubernetesVersion: v1.14.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:58:24.871576  429159 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.14.0/kubelet --allow-privileged=true --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --client-ca-file=/var/lib/minikube/certs/ca.crt --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=kubernetes-upgrade-20210813205735-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.75 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20210813205735-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:58:24.871637  429159 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.14.0

	I0813 20:58:24.882390  429159 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:58:24.882472  429159 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:58:24.891407  429159 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (627 bytes)

	I0813 20:58:24.905473  429159 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:58:24.920036  429159 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2168 bytes)

	I0813 20:58:24.935864  429159 ssh_runner.go:149] Run: grep 192.168.39.75	control-plane.minikube.internal$ /etc/hosts

	I0813 20:58:24.941474  429159 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.75	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:58:24.954613  429159 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438 for IP: 192.168.39.75

	I0813 20:58:24.954693  429159 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:58:24.954717  429159 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:58:24.954794  429159 certs.go:297] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.key

	I0813 20:58:24.954840  429159 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt with IP's: []

	I0813 20:58:24.734703  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5: (4.199112085s)

	I0813 20:58:24.734729  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache

	I0813 20:58:24.734750  429197 containerd.go:280] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.4

	I0813 20:58:24.734795  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.4

	I0813 20:58:24.285934  429419 node_ready.go:35] waiting up to 6m0s for node "pause-20210813205520-393438" to be "Ready" ...

	I0813 20:58:24.286205  429419 start.go:708] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0813 20:58:24.290741  429419 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:58:24.291627  429419 node_ready.go:49] node "pause-20210813205520-393438" has status "Ready":"True"

	I0813 20:58:24.291649  429419 node_ready.go:38] duration metric: took 5.67319ms waiting for node "pause-20210813205520-393438" to be "Ready" ...

	I0813 20:58:24.291661  429419 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 20:58:24.298236  429419 pod_ready.go:78] waiting up to 6m0s for pod "coredns-558bd4d5db-jzmnb" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:24.309828  429419 pod_ready.go:92] pod "coredns-558bd4d5db-jzmnb" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:24.309851  429419 pod_ready.go:81] duration metric: took 11.58702ms waiting for pod "coredns-558bd4d5db-jzmnb" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:24.309864  429419 pod_ready.go:78] waiting up to 6m0s for pod "etcd-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:24.320467  429419 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 20:58:25.534311  429419 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.213810615s)

	I0813 20:58:25.534363  429419 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:25.534375  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .Close

	I0813 20:58:25.534492  429419 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.243729186s)

	I0813 20:58:25.534544  429419 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:25.534569  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .Close

	I0813 20:58:25.534756  429419 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:25.534789  429419 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:25.534814  429419 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:25.534837  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .Close

	I0813 20:58:25.535076  429419 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:25.535091  429419 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:25.535101  429419 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:25.535122  429419 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:25.535129  429419 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:25.535139  429419 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:25.535147  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .Close

	I0813 20:58:25.535857  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:58:25.537678  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:58:25.537716  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:58:25.537769  429419 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:25.537799  429419 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:25.537718  429419 main.go:130] libmachine: (pause-20210813205520-393438) Calling .Close

	I0813 20:58:25.540033  429419 main.go:130] libmachine: (pause-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:58:25.540081  429419 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:25.540099  429419 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:25.099453  429159 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt ...

	I0813 20:58:25.099491  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt: {Name:mkae4d24d257c78563025918a6580ab99b0feaed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.100261  429159 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.key ...

	I0813 20:58:25.100287  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.key: {Name:mkfa8d8f503a7d06056da439d2d73adec0800347 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.100741  429159 certs.go:297] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key.c1c3c514

	I0813 20:58:25.100758  429159 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt.c1c3c514 with IP's: [192.168.39.75 10.96.0.1 127.0.0.1 10.0.0.1]

	I0813 20:58:25.316635  429159 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt.c1c3c514 ...

	I0813 20:58:25.316682  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt.c1c3c514: {Name:mk0ddc88b2eae04f840601f11a91883e44b6c00a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.317576  429159 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key.c1c3c514 ...

	I0813 20:58:25.317607  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key.c1c3c514: {Name:mk1da4a4675302206daa112b196fa85d8764a1bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.318247  429159 certs.go:308] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt.c1c3c514 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt

	I0813 20:58:25.318344  429159 certs.go:312] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key.c1c3c514 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key

	I0813 20:58:25.318422  429159 certs.go:297] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.key

	I0813 20:58:25.318437  429159 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.crt with IP's: []

	I0813 20:58:25.449177  429159 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.crt ...

	I0813 20:58:25.449231  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.crt: {Name:mk6f31139e78ecf9d1a0fff92b8da6a65ce6ed9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.471285  429159 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.key ...

	I0813 20:58:25.471329  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.key: {Name:mkc7202e4bb67118a2e10bfb24a71a22b8a58801 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:25.472144  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:58:25.472203  429159 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:58:25.472222  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:58:25.472254  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:58:25.472287  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:58:25.472321  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:58:25.472424  429159 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:25.473721  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:58:25.499280  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:58:25.520376  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:58:25.545225  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0813 20:58:25.571406  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:58:25.593463  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:58:25.615334  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:58:25.635664  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:58:25.657451  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:58:25.678614  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:58:25.706563  429159 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:58:25.734769  429159 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:58:25.757416  429159 ssh_runner.go:149] Run: openssl version

	I0813 20:58:25.765477  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:58:25.774945  429159 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:25.780945  429159 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:25.780994  429159 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:25.788946  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:58:25.798444  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:58:25.810230  429159 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:58:25.815899  429159 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:58:25.815948  429159 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:58:25.824003  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:58:25.833913  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:58:25.844086  429159 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:58:25.850227  429159 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:58:25.850313  429159 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:58:25.858336  429159 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:58:25.868532  429159 kubeadm.go:390] StartCluster: {Name:kubernetes-upgrade-20210813205735-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersi

on:v1.14.0 ClusterName:kubernetes-upgrade-20210813205735-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:25.868629  429159 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:58:25.868681  429159 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:25.921567  429159 cri.go:76] found id: ""

	I0813 20:58:25.921655  429159 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:58:25.932828  429159 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:58:25.945134  429159 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 20:58:25.953921  429159 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 20:58:25.953967  429159 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap"

	I0813 20:58:22.872137  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:23.372637  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:23.872522  428960 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:23.914265  428960 api_server.go:70] duration metric: took 13.058602066s to wait for apiserver process to appear ...

	I0813 20:58:23.914297  428960 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:58:23.914309  428960 api_server.go:239] Checking apiserver healthz at https://192.168.72.169:8443/healthz ...

	I0813 20:58:23.915203  428960 api_server.go:255] stopped: https://192.168.72.169:8443/healthz: Get "https://192.168.72.169:8443/healthz": dial tcp 192.168.72.169:8443: connect: connection refused

	I0813 20:58:24.416080  428960 api_server.go:239] Checking apiserver healthz at https://192.168.72.169:8443/healthz ...

	I0813 20:58:25.542262  429419 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0813 20:58:25.542283  429419 addons.go:344] enableAddons completed in 1.483681724s

	I0813 20:58:26.334738  429419 pod_ready.go:102] pod "etcd-pause-20210813205520-393438" in "kube-system" namespace has status "Ready":"False"

	I0813 20:58:26.828297  429419 pod_ready.go:92] pod "etcd-pause-20210813205520-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:26.828324  429419 pod_ready.go:81] duration metric: took 2.518451386s waiting for pod "etcd-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:26.828338  429419 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:26.836849  429419 pod_ready.go:92] pod "kube-apiserver-pause-20210813205520-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:26.836871  429419 pod_ready.go:81] duration metric: took 8.524124ms waiting for pod "kube-apiserver-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:26.836886  429419 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.862455  429419 pod_ready.go:92] pod "kube-controller-manager-pause-20210813205520-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:27.862481  429419 pod_ready.go:81] duration metric: took 1.025585866s waiting for pod "kube-controller-manager-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.862494  429419 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-mlf5c" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.870208  429419 pod_ready.go:92] pod "kube-proxy-mlf5c" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:27.870232  429419 pod_ready.go:81] duration metric: took 7.73045ms waiting for pod "kube-proxy-mlf5c" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.870245  429419 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.891134  429419 pod_ready.go:92] pod "kube-scheduler-pause-20210813205520-393438" in "kube-system" namespace has status "Ready":"True"

	I0813 20:58:27.891160  429419 pod_ready.go:81] duration metric: took 20.905213ms waiting for pod "kube-scheduler-pause-20210813205520-393438" in "kube-system" namespace to be "Ready" ...

	I0813 20:58:27.891170  429419 pod_ready.go:38] duration metric: took 3.599496172s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 20:58:27.891188  429419 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:58:27.891241  429419 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:27.905112  429419 api_server.go:70] duration metric: took 3.846582491s to wait for apiserver process to appear ...

	I0813 20:58:27.905137  429419 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:58:27.905149  429419 api_server.go:239] Checking apiserver healthz at https://192.168.61.151:8443/healthz ...

	I0813 20:58:27.914448  429419 api_server.go:265] https://192.168.61.151:8443/healthz returned 200:

	ok

	I0813 20:58:27.916188  429419 api_server.go:139] control plane version: v1.21.3

	I0813 20:58:27.916211  429419 api_server.go:129] duration metric: took 11.066889ms to wait for apiserver health ...

	I0813 20:58:27.916220  429419 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 20:58:28.094936  429419 system_pods.go:59] 7 kube-system pods found

	I0813 20:58:28.094972  429419 system_pods.go:61] "coredns-558bd4d5db-jzmnb" [ea00ae4c-f4d9-414c-8762-6314a96c8a06] Running

	I0813 20:58:28.094981  429419 system_pods.go:61] "etcd-pause-20210813205520-393438" [c0f74993-053a-4721-89b9-a9f01c83cb4e] Running

	I0813 20:58:28.094988  429419 system_pods.go:61] "kube-apiserver-pause-20210813205520-393438" [1625a41a-5bb8-43ff-b2ca-fc5a2e96907d] Running

	I0813 20:58:28.094995  429419 system_pods.go:61] "kube-controller-manager-pause-20210813205520-393438" [203329cf-5319-4902-8b08-c8ce7d0adc7a] Running

	I0813 20:58:28.095002  429419 system_pods.go:61] "kube-proxy-mlf5c" [c0812228-e936-4bfa-9fbb-a4d0707f2a63] Running

	I0813 20:58:28.095009  429419 system_pods.go:61] "kube-scheduler-pause-20210813205520-393438" [a931b4e6-b130-4886-a7dc-604f54907b2f] Running

	I0813 20:58:28.095015  429419 system_pods.go:61] "storage-provisioner" [99920d7c-bb8d-4c65-bf44-b56f23a40e53] Running

	I0813 20:58:28.095024  429419 system_pods.go:74] duration metric: took 178.797733ms to wait for pod list to return data ...

	I0813 20:58:28.095037  429419 default_sa.go:34] waiting for default service account to be created ...

	I0813 20:58:28.293159  429419 default_sa.go:45] found service account: "default"

	I0813 20:58:28.293188  429419 default_sa.go:55] duration metric: took 198.132212ms for default service account to be created ...

	I0813 20:58:28.293201  429419 system_pods.go:116] waiting for k8s-apps to be running ...

	I0813 20:58:28.493886  429419 system_pods.go:86] 7 kube-system pods found

	I0813 20:58:28.493920  429419 system_pods.go:89] "coredns-558bd4d5db-jzmnb" [ea00ae4c-f4d9-414c-8762-6314a96c8a06] Running

	I0813 20:58:28.493928  429419 system_pods.go:89] "etcd-pause-20210813205520-393438" [c0f74993-053a-4721-89b9-a9f01c83cb4e] Running

	I0813 20:58:28.493935  429419 system_pods.go:89] "kube-apiserver-pause-20210813205520-393438" [1625a41a-5bb8-43ff-b2ca-fc5a2e96907d] Running

	I0813 20:58:28.493942  429419 system_pods.go:89] "kube-controller-manager-pause-20210813205520-393438" [203329cf-5319-4902-8b08-c8ce7d0adc7a] Running

	I0813 20:58:28.493948  429419 system_pods.go:89] "kube-proxy-mlf5c" [c0812228-e936-4bfa-9fbb-a4d0707f2a63] Running

	I0813 20:58:28.493954  429419 system_pods.go:89] "kube-scheduler-pause-20210813205520-393438" [a931b4e6-b130-4886-a7dc-604f54907b2f] Running

	I0813 20:58:28.493960  429419 system_pods.go:89] "storage-provisioner" [99920d7c-bb8d-4c65-bf44-b56f23a40e53] Running

	I0813 20:58:28.493969  429419 system_pods.go:126] duration metric: took 200.762018ms to wait for k8s-apps to be running ...

	I0813 20:58:28.493979  429419 system_svc.go:44] waiting for kubelet service to be running ....

	I0813 20:58:28.494028  429419 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:58:28.511568  429419 system_svc.go:56] duration metric: took 17.580044ms WaitForService to wait for kubelet.

	I0813 20:58:28.511598  429419 kubeadm.go:547] duration metric: took 4.453071155s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0813 20:58:28.511622  429419 node_conditions.go:102] verifying NodePressure condition ...

	I0813 20:58:28.692948  429419 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0813 20:58:28.692983  429419 node_conditions.go:123] node cpu capacity is 2

	I0813 20:58:28.693007  429419 node_conditions.go:105] duration metric: took 181.379058ms to run NodePressure ...

	I0813 20:58:28.693024  429419 start.go:231] waiting for startup goroutines ...

	I0813 20:58:28.787756  429419 start.go:462] kubectl: 1.20.5, cluster: 1.21.3 (minor skew: 1)

	I0813 20:58:28.790013  429419 out.go:177] * Done! kubectl is now configured to use "pause-20210813205520-393438" cluster and "default" namespace by default

	I0813 20:58:27.088638  429159 out.go:204]   - Generating certificates and keys ...

	I0813 20:58:26.987192  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.4: (2.252367187s)

	I0813 20:58:26.987224  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 from cache

	I0813 20:58:26.987260  429197 containerd.go:280] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I0813 20:58:26.987309  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I0813 20:58:28.378335  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0: (1.390986894s)

	I0813 20:58:28.378374  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 from cache

	I0813 20:58:28.378404  429197 containerd.go:280] Loading image: /var/lib/minikube/images/kube-proxy_v1.20.0

	I0813 20:58:28.378489  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	33fae69af6bcf       6e38f40d628db       5 seconds ago        Running             storage-provisioner       0                   76aee79f917be

	b6372d9d76486       296a6d5035e2d       20 seconds ago       Running             coredns                   1                   cfc4c8785e479

	afabb5f130410       0369cf4303ffd       20 seconds ago       Running             etcd                      1                   3f41ec729ef71

	57f3f32f280d8       bc2bb319a7038       21 seconds ago       Running             kube-controller-manager   1                   ce1823a3db17a

	1053b5b4ba3ab       3d174f00aa39e       21 seconds ago       Running             kube-apiserver            1                   a655f217cf1c5

	0d1a942c8b8c2       adb2816ea823a       22 seconds ago       Running             kube-proxy                1                   47e050012dbca

	1d84b053549cf       6be0dc1302e30       22 seconds ago       Running             kube-scheduler            1                   53f314c6cf963

	1bba0d6deb033       adb2816ea823a       About a minute ago   Exited              kube-proxy                0                   3f6f239c2851f

	63c0cc1fc4c0c       296a6d5035e2d       About a minute ago   Exited              coredns                   0                   b1f1f31f28005

	698bbea7ce6e9       6be0dc1302e30       About a minute ago   Exited              kube-scheduler            0                   5a66336a35add

	df02c38abac90       0369cf4303ffd       About a minute ago   Exited              etcd                      0                   4cf745987f602

	68bad43283064       bc2bb319a7038       About a minute ago   Exited              kube-controller-manager   0                   5340b4aa5ca39

	11c2753c9a8a7       3d174f00aa39e       About a minute ago   Exited              kube-apiserver            0                   304b611d719ea

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:58:32 UTC. --

	Aug 13 20:58:10 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:10.602825484Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\""

	Aug 13 20:58:10 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:10.630050995Z" level=info msg="CreateContainer within sandbox \"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:1,}"

	Aug 13 20:58:10 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:10.674267060Z" level=info msg="StartContainer for \"1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c\" returns successfully"

	Aug 13 20:58:10 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:10.848732655Z" level=info msg="CreateContainer within sandbox \"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:1,} returns container id \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\""

	Aug 13 20:58:10 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:10.859627067Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.078142311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:etcd-pause-20210813205520-393438,Uid:86a000e5c08d32d80b2fd4e89cd34dd1,Namespace:kube-system,Attempt:1,} returns sandbox id \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.145266794Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for container &ContainerMetadata{Name:etcd,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.321521915Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\" returns successfully"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.349622186Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for &ContainerMetadata{Name:etcd,Attempt:1,} returns container id \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.353268082Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.376810925Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-558bd4d5db-jzmnb,Uid:ea00ae4c-f4d9-414c-8762-6314a96c8a06,Namespace:kube-system,Attempt:1,} returns sandbox id \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.451595226Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for container &ContainerMetadata{Name:coredns,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.633919582Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for &ContainerMetadata{Name:coredns,Attempt:1,} returns container id \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.635324605Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.770314446Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.016041628Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.229109322Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\" returns successfully"

	Aug 13 20:58:15 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:15.472167045Z" level=info msg="StartContainer for \"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5\" returns successfully"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.856093567Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,}"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.901091488Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a pid=4886

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.481756294Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,} returns sandbox id \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.492027606Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.607213854Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.614295374Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.876068804Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\" returns successfully"

	* 

	* ==> coredns [63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I0813 20:57:49.980199       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.978) (total time: 30001ms):

	Trace[2019727887]: [30.001847928s] [30.001847928s] END

	E0813 20:57:49.980279       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.980655       1 trace.go:205] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[939984059]: [30.00501838s] [30.00501838s] END

	E0813 20:57:49.980691       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.981307       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[911902081]: [30.005916603s] [30.005916603s] END

	E0813 20:57:49.981521       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	E0813 20:58:20.310855       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:coredns" cannot list resource "services" in API group "" at the cluster scope

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	*                 "trace_clock=local"

	              on the kernel command line

	[  +0.000017] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.863604] systemd-fstab-generator[1160]: Ignoring "noauto" for root device

	[  +0.032050] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +0.917916] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=1722 comm=systemd-network

	[  +2.669268] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.

	[  +0.335717] vboxguest: loading out-of-tree module taints kernel.

	[  +0.008488] vboxguest: PCI device not found, probably running on physical hardware.

	[Aug13 20:56] systemd-fstab-generator[2101]: Ignoring "noauto" for root device

	[  +0.927578] systemd-fstab-generator[2132]: Ignoring "noauto" for root device

	[  +0.140064] systemd-fstab-generator[2146]: Ignoring "noauto" for root device

	[  +0.195734] systemd-fstab-generator[2179]: Ignoring "noauto" for root device

	[  +8.321149] systemd-fstab-generator[2386]: Ignoring "noauto" for root device

	[Aug13 20:57] systemd-fstab-generator[2823]: Ignoring "noauto" for root device

	[ +16.072552] kauditd_printk_skb: 38 callbacks suppressed

	[ +34.372009] kauditd_printk_skb: 116 callbacks suppressed

	[  +3.958113] NFSD: Unable to end grace period: -110

	[Aug13 20:58] systemd-fstab-generator[3706]: Ignoring "noauto" for root device

	[  +0.206181] systemd-fstab-generator[3719]: Ignoring "noauto" for root device

	[  +0.261980] systemd-fstab-generator[3744]: Ignoring "noauto" for root device

	[ +19.584639] kauditd_printk_skb: 41 callbacks suppressed

	[  +5.482860] systemd-fstab-generator[4981]: Ignoring "noauto" for root device

	[  +0.846439] systemd-fstab-generator[5035]: Ignoring "noauto" for root device

	* 

	* ==> etcd [afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5] <==

	* 2021-08-13 20:58:16.461857 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true " with result "range_response_count:0 size:5" took too long (198.960862ms) to execute

	2021-08-13 20:58:16.462013 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 " with result "range_response_count:0 size:5" took too long (199.025411ms) to execute

	2021-08-13 20:58:16.462116 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (190.42222ms) to execute

	2021-08-13 20:58:16.462337 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (179.184455ms) to execute

	2021-08-13 20:58:16.462702 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (172.711746ms) to execute

	2021-08-13 20:58:16.462925 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (170.528555ms) to execute

	2021-08-13 20:58:16.463221 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (158.293847ms) to execute

	2021-08-13 20:58:16.463747 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (158.490371ms) to execute

	2021-08-13 20:58:16.464124 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (152.464331ms) to execute

	2021-08-13 20:58:16.477058 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (151.343452ms) to execute

	2021-08-13 20:58:16.478005 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" count_only:true " with result "range_response_count:0 size:5" took too long (142.028022ms) to execute

	2021-08-13 20:58:16.478939 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" limit:10000 " with result "range_response_count:0 size:5" took too long (142.259692ms) to execute

	2021-08-13 20:58:16.479721 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (129.328346ms) to execute

	2021-08-13 20:58:16.479967 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (126.882803ms) to execute

	2021-08-13 20:58:16.480303 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:10000 " with result "range_response_count:11 size:5977" took too long (116.866258ms) to execute

	2021-08-13 20:58:16.480852 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true " with result "range_response_count:0 size:7" took too long (116.970061ms) to execute

	2021-08-13 20:58:23.354247 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/cluster-admin\" " with result "range_response_count:1 size:718" took too long (1.914180768s) to execute

	2021-08-13 20:58:23.356685 W | etcdserver: request "header:<ID:14244176716868856811 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" value_size:717 lease:5020804680014080881 >> failure:<>>" with result "size:16" took too long (1.23562281s) to execute

	2021-08-13 20:58:23.370142 W | wal: sync duration of 1.250273887s, expected less than 1s

	2021-08-13 20:58:23.370676 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.152835664s) to execute

	2021-08-13 20:58:23.371565 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.728436243s) to execute

	2021-08-13 20:58:23.371769 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.847351028s) to execute

	2021-08-13 20:58:23.378962 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-558bd4d5db-jzmnb\" " with result "range_response_count:1 size:4862" took too long (671.753147ms) to execute

	2021-08-13 20:58:24.705568 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:1 size:4394" took too long (221.501911ms) to execute

	2021-08-13 20:58:26.341296 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418] <==

	* 2021-08-13 20:56:51.867973 I | embed: serving client requests on 192.168.61.151:2379

	2021-08-13 20:56:51.875825 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:57:01.271062 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpointslicemirroring-controller\" " with result "range_response_count:0 size:5" took too long (480.2351ms) to execute

	2021-08-13 20:57:01.272131 W | etcdserver: read-only range request "key:\"/registry/minions/pause-20210813205520-393438\" " with result "range_response_count:1 size:3758" took too long (875.676682ms) to execute

	2021-08-13 20:57:01.273551 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f12dc\" " with result "range_response_count:1 size:735" took too long (792.283833ms) to execute

	2021-08-13 20:57:02.171621 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (872.818648ms) to execute

	2021-08-13 20:57:02.172160 W | etcdserver: request "header:<ID:14244176716848216677 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:222 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3993 >> failure:<request_range:<key:\"/registry/minions/pause-20210813205520-393438\" > >>" with result "size:16" took too long (128.660032ms) to execute

	2021-08-13 20:57:02.172330 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:351" took too long (871.615956ms) to execute

	2021-08-13 20:57:02.172733 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f2f58\" " with result "range_response_count:1 size:733" took too long (859.92991ms) to execute

	2021-08-13 20:57:02.172849 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (853.236151ms) to execute

	2021-08-13 20:57:09.290631 W | etcdserver: request "header:<ID:14244176716848216792 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:0 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3277 >> failure:<>>" with result "size:5" took too long (472.704737ms) to execute

	2021-08-13 20:57:09.291659 W | etcdserver: read-only range request "key:\"/registry/leases/kube-node-lease/pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (897.879132ms) to execute

	2021-08-13 20:57:09.298807 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-pause-20210813205520-393438\" " with result "range_response_count:1 size:4986" took too long (528.421007ms) to execute

	2021-08-13 20:57:09.299124 W | etcdserver: read-only range request "key:\"/registry/csinodes/pause-20210813205520-393438\" " with result "range_response_count:1 size:656" took too long (894.254864ms) to execute

	2021-08-13 20:57:13.314052 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" " with result "range_response_count:1 size:210" took too long (127.466898ms) to execute

	2021-08-13 20:57:13.314663 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (132.387511ms) to execute

	2021-08-13 20:57:16.343764 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:20.988739 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:30.989151 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:39.442816 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:422" took too long (120.094417ms) to execute

	2021-08-13 20:57:40.988900 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:50.989064 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:58:00.244154 W | etcdserver: request "header:<ID:14244176716848217456 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.61.151\" mod_revision:483 > success:<request_put:<key:\"/registry/masterleases/192.168.61.151\" value_size:69 lease:5020804679993441646 >> failure:<request_range:<key:\"/registry/masterleases/192.168.61.151\" > >>" with result "size:16" took too long (162.220853ms) to execute

	2021-08-13 20:58:00.245134 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (881.389444ms) to execute

	2021-08-13 20:58:00.989778 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:58:42 up 2 min,  0 users,  load average: 1.91, 0.94, 0.37

	Linux pause-20210813205520-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c] <==

	* I0813 20:58:20.351321       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 20:58:20.372737       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 20:58:20.375890       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 20:58:20.387225       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 20:58:20.401103       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:58:20.403283       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 20:58:20.407207       1 cache.go:39] Caches are synced for autoregister controller

	I0813 20:58:20.410957       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 20:58:21.065658       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 20:58:21.066635       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 20:58:21.090819       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 20:58:23.358425       1 trace.go:205] Trace[1442514083]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.628) (total time: 1729ms):

	Trace[1442514083]: ---"Object stored in database" 1729ms (20:58:00.358)

	Trace[1442514083]: [1.729557914s] [1.729557914s] END

	I0813 20:58:23.359893       1 trace.go:205] Trace[553017594]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/cluster-admin,user-agent:kube-apiserver/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.438) (total time: 1920ms):

	Trace[553017594]: ---"About to write a response" 1919ms (20:58:00.358)

	Trace[553017594]: [1.920866407s] [1.920866407s] END

	I0813 20:58:23.381663       1 trace.go:205] Trace[1143050190]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-jzmnb,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:22.699) (total time: 682ms):

	Trace[1143050190]: ---"About to write a response" 681ms (20:58:00.380)

	Trace[1143050190]: [682.310081ms] [682.310081ms] END

	I0813 20:58:25.230359       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 20:58:25.281700       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 20:58:25.373725       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0813 20:58:25.413105       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:58:25.560667       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io

	* 

	* ==> kube-apiserver [11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016] <==

	* I0813 20:57:09.309542       1 trace.go:205] Trace[2046907584]: "Create" url:/api/v1/nodes,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.501) (total time: 806ms):

	Trace[2046907584]: [806.482297ms] [806.482297ms] END

	I0813 20:57:09.310802       1 trace.go:205] Trace[146959614]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.771) (total time: 538ms):

	Trace[146959614]: ---"Object stored in database" 538ms (20:57:00.310)

	Trace[146959614]: [538.954794ms] [538.954794ms] END

	I0813 20:57:09.311138       1 trace.go:205] Trace[1128950750]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-pause-20210813205520-393438,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1128950750]: ---"About to write a response" 537ms (20:57:00.307)

	Trace[1128950750]: [541.267103ms] [541.267103ms] END

	I0813 20:57:09.311248       1 trace.go:205] Trace[1268223707]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1268223707]: ---"Object stored in database" 540ms (20:57:00.310)

	Trace[1268223707]: [541.971563ms] [541.971563ms] END

	I0813 20:57:09.311433       1 trace.go:205] Trace[1977445463]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.772) (total time: 538ms):

	Trace[1977445463]: ---"Object stored in database" 537ms (20:57:00.310)

	Trace[1977445463]: [538.348208ms] [538.348208ms] END

	I0813 20:57:09.321803       1 trace.go:205] Trace[494614999]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 552ms):

	Trace[494614999]: [552.453895ms] [552.453895ms] END

	I0813 20:57:09.345220       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:57:16.259955       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	I0813 20:57:16.380865       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0813 20:57:37.272234       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:57:37.272418       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:57:37.272507       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:58:00.246413       1 trace.go:205] Trace[1997979141]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (13-Aug-2021 20:57:59.258) (total time: 987ms):

	Trace[1997979141]: ---"Transaction committed" 984ms (20:58:00.246)

	Trace[1997979141]: [987.521712ms] [987.521712ms] END

	* 

	* ==> kube-controller-manager [57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849] <==

	* I0813 20:58:25.074041       1 daemon_controller.go:285] Starting daemon sets controller

	I0813 20:58:25.074050       1 shared_informer.go:240] Waiting for caches to sync for daemon sets

	I0813 20:58:25.116517       1 controllermanager.go:574] Started "horizontalpodautoscaling"

	I0813 20:58:25.116556       1 horizontal.go:169] Starting HPA controller

	I0813 20:58:25.116758       1 shared_informer.go:240] Waiting for caches to sync for HPA

	E0813 20:58:25.120839       1 core.go:91] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail

	W0813 20:58:25.120857       1 controllermanager.go:566] Skipping "service"

	I0813 20:58:25.124370       1 controllermanager.go:574] Started "persistentvolume-expander"

	I0813 20:58:25.124569       1 expand_controller.go:327] Starting expand controller

	I0813 20:58:25.124579       1 shared_informer.go:240] Waiting for caches to sync for expand

	I0813 20:58:25.175876       1 controllermanager.go:574] Started "namespace"

	I0813 20:58:25.176251       1 namespace_controller.go:200] Starting namespace controller

	I0813 20:58:25.176376       1 shared_informer.go:240] Waiting for caches to sync for namespace

	I0813 20:58:25.185657       1 controllermanager.go:574] Started "serviceaccount"

	I0813 20:58:25.187325       1 serviceaccounts_controller.go:117] Starting service account controller

	I0813 20:58:25.187340       1 shared_informer.go:240] Waiting for caches to sync for service account

	I0813 20:58:25.192151       1 controllermanager.go:574] Started "replicaset"

	I0813 20:58:25.192315       1 replica_set.go:182] Starting replicaset controller

	I0813 20:58:25.192327       1 shared_informer.go:240] Waiting for caches to sync for ReplicaSet

	I0813 20:58:25.200141       1 controllermanager.go:574] Started "bootstrapsigner"

	I0813 20:58:25.200611       1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer

	I0813 20:58:25.204061       1 controllermanager.go:574] Started "cronjob"

	I0813 20:58:25.204578       1 cronjob_controllerv2.go:125] Starting cronjob controller v2

	I0813 20:58:25.204590       1 shared_informer.go:240] Waiting for caches to sync for cronjob

	I0813 20:58:25.207401       1 node_ipam_controller.go:91] Sending events to api server.

	* 

	* ==> kube-controller-manager [68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8] <==

	* I0813 20:57:15.593972       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:57:15.593991       1 disruption.go:371] Sending events to api server.

	I0813 20:57:15.596695       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:57:15.636700       1 shared_informer.go:247] Caches are synced for service account 

	I0813 20:57:15.652896       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:57:15.701400       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:57:15.701628       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:57:15.701702       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:57:15.701748       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:57:15.701825       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:57:15.702024       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	I0813 20:57:15.735577       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0813 20:57:15.751667       1 shared_informer.go:247] Caches are synced for stateful set 

	I0813 20:57:15.767285       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:15.796364       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:57:15.847876       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:16.199991       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.200121       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:57:16.224599       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.277997       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:57:16.457337       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-mlf5c"

	I0813 20:57:16.545672       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-fhxw7"

	I0813 20:57:16.596799       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-jzmnb"

	I0813 20:57:16.804186       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:57:16.819742       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-fhxw7"

	* 

	* ==> kube-proxy [0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5] <==

	* E0813 20:58:20.334846       1 node.go:161] Failed to retrieve node info: nodes "pause-20210813205520-393438" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I0813 20:58:21.364522       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:58:21.365223       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:58:21.366125       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:58:23.461362       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:58:23.462248       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:58:23.465333       1 server_others.go:212] Using iptables Proxier.

	I0813 20:58:23.483125       1 server.go:643] Version: v1.21.3

	I0813 20:58:23.488959       1 config.go:315] Starting service config controller

	I0813 20:58:23.490323       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:58:23.490593       1 config.go:224] Starting endpoint slice config controller

	I0813 20:58:23.490606       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:58:23.512424       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:58:23.514744       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:58:23.591163       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:58:23.593313       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62] <==

	* I0813 20:57:20.123665       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:57:20.123841       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:57:20.123909       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:57:20.180054       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:57:20.180158       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:57:20.180173       1 server_others.go:212] Using iptables Proxier.

	I0813 20:57:20.181825       1 server.go:643] Version: v1.21.3

	I0813 20:57:20.184367       1 config.go:315] Starting service config controller

	I0813 20:57:20.184561       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:57:20.184600       1 config.go:224] Starting endpoint slice config controller

	I0813 20:57:20.184604       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:57:20.203222       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:57:20.207174       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:57:20.285130       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:57:20.285144       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c] <==

	* I0813 20:58:11.830530       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:58:20.220887       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:58:20.224373       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:58:20.224624       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:58:20.224640       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:58:20.341243       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:58:20.343223       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.343608       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.347257       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:58:20.444874       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889] <==

	* I0813 20:56:57.340096       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:56:57.373873       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:57.375600       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:57.398047       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:57.406392       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:56:57.418940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.424521       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:57.426539       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:56:57.426578       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:56:57.428616       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428765       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:56:57.428811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:57.428897       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:56:58.261670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:58.311937       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:58.405804       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.463800       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:58.585826       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.615525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:58.626736       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.669986       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:58.791820       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0813 20:57:01.440271       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:58:43 UTC. --

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.453957    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454194    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454410    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454727    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454757    2832 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.611414    2832 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210813205520-393438.169af943ec02b0a4", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210813205520-393438", UID:"36ca0d21ef43020c8f018e62049ff15f", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readines

s probe failed: Get \"https://192.168.61.151:8443/readyz\": dial tcp 192.168.61.151:8443: connect: connection refused", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210813205520-393438"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.61.151:8443: connect: connection refused'(may retry after sleeping)

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.428873    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429203    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429890    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430165    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430396    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:10.430620    2832 controller.go:114] failed to update lease using latest lease, fallback to ensure lease, err: failed 5 attempts to update lease

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430883    2832 controller.go:144] failed to ensure lease exists, will retry in 200ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.632976    2832 controller.go:144] failed to ensure lease exists, will retry in 400ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:11.038724    2832 controller.go:144] failed to ensure lease exists, will retry in 800ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:11.294567    2832 status_manager.go:566] "Failed to get status for pod" podUID=469cea0375ae276925a50e4dde7e4ace pod="kube-system/kube-scheduler-pause-20210813205520-393438" error="Get \"https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-pause-20210813205520-393438\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.266431    2832 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.269986    2832 reflector.go:138] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.541317    2832 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590904    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6vd\" (UniqueName: \"kubernetes.io/projected/99920d7c-bb8d-4c65-bf44-b56f23a40e53-kube-api-access-xw6vd\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590979    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/99920d7c-bb8d-4c65-bf44-b56f23a40e53-tmp\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:29 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:29.362225    2832 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: kubelet.service: Succeeded.

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81] <==

	* 	/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:880 +0x4af

	goroutine 90 [sync.Cond.Wait]:

	sync.runtime_notifyListWait(0xc000328290, 0xc000000003)

		/usr/local/go/src/runtime/sema.go:513 +0xf8

	sync.(*Cond).Wait(0xc000328280)

		/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0003f0480, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003bcc80, 0x18e5530, 0xc0003284c0, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004ceee0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0004ceee0, 0x18b3d60, 0xc000311f80, 0x1, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004ceee0, 0x3b9aca00, 0x0, 0x17a0501, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc0004ceee0, 0x3b9aca00, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

-- /stdout --

** stderr ** 

	E0813 20:58:42.500616  429686 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:250: failed logs error: exit status 110

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (328.445481ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25

helpers_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25: exit status 110 (11.591217955s)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                   Args                   |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:34 UTC | Fri, 13 Aug 2021 20:31:44 UTC |

	|         | node start m03                           |                                          |         |         |                               |                               |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	| stop    | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:31:45 UTC | Fri, 13 Aug 2021 20:34:51 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:34:51 UTC | Fri, 13 Aug 2021 20:40:57 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:40:58 UTC | Fri, 13 Aug 2021 20:40:59 UTC |

	|         | node delete m03                          |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:41:00 UTC | Fri, 13 Aug 2021 20:44:04 UTC |

	|         | stop                                     |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:44:04 UTC | Fri, 13 Aug 2021 20:48:01 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr --driver=kvm2          |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:48:01 UTC | Fri, 13 Aug 2021 20:49:01 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:02 UTC | Fri, 13 Aug 2021 20:49:03 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:03 UTC | Fri, 13 Aug 2021 20:49:05 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:50:38 UTC | Fri, 13 Aug 2021 20:52:46 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | --wait=true --preload=false              |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:47 UTC | Fri, 13 Aug 2021 20:52:48 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl pull busybox              |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:48 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=kvm2           |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl image ls                  |                                          |         |         |                               |                               |

	| delete  | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:41 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	| start   | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:41 UTC | Fri, 13 Aug 2021 20:54:41 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --memory=2048 --driver=kvm2              |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:42 UTC | Fri, 13 Aug 2021 20:54:42 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --cancel-scheduled                       |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:55 UTC | Fri, 13 Aug 2021 20:55:02 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --schedule 5s                            |                                          |         |         |                               |                               |

	| delete  | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:20 UTC | Fri, 13 Aug 2021 20:55:20 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	| start   | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:33 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048     |                                          |         |         |                               |                               |

	|         | --wait=true --driver=kvm2                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:33 UTC | Fri, 13 Aug 2021 20:57:35 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:54 UTC |

	|         | --memory=2048                            |                                          |         |         |                               |                               |

	|         | --install-addons=false                   |                                          |         |         |                               |                               |

	|         | --wait=all --driver=kvm2                 |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:54 UTC | Fri, 13 Aug 2021 20:58:28 UTC |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:27 UTC | Fri, 13 Aug 2021 20:58:34 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| logs    | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:34 UTC | Fri, 13 Aug 2021 20:58:35 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| delete  | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:35 UTC | Fri, 13 Aug 2021 20:58:36 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:58:36

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:58:36.952203  429844 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:58:36.952268  429844 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:36.952271  429844 out.go:311] Setting ErrFile to fd 2...

	I0813 20:58:36.952274  429844 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:36.952377  429844 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:58:36.952620  429844 out.go:305] Setting JSON to false

	I0813 20:58:36.993458  429844 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":6079,"bootTime":1628882238,"procs":193,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:58:36.993602  429844 start.go:121] virtualization: kvm guest

	I0813 20:58:36.996289  429844 out.go:177] * [force-systemd-env-20210813205836-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:58:36.998267  429844 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:36.996433  429844 notify.go:169] Checking for updates...

	I0813 20:58:36.999665  429844 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:58:37.001250  429844 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.002637  429844 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:58:37.004247  429844 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0813 20:58:37.004726  429844 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:58:37.004843  429844 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:58:37.004926  429844 config.go:177] Loaded profile config "running-upgrade-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I0813 20:58:37.004973  429844 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:58:37.038645  429844 out.go:177] * Using the kvm2 driver based on user configuration

	I0813 20:58:37.038692  429844 start.go:278] selected driver: kvm2

	I0813 20:58:37.038699  429844 start.go:751] validating driver "kvm2" against <nil>

	I0813 20:58:37.038719  429844 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:58:37.039903  429844 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:58:37.040054  429844 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:58:37.053876  429844 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:58:37.053933  429844 start_flags.go:263] no existing cluster config was found, will generate one from the flags 

	I0813 20:58:37.054106  429844 start_flags.go:679] Wait components to verify : map[apiserver:true system_pods:true]

	I0813 20:58:37.054129  429844 cni.go:93] Creating CNI manager for ""

	I0813 20:58:37.054137  429844 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:37.054146  429844 start_flags.go:272] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0813 20:58:37.054157  429844 start_flags.go:277] config:

	{Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clust

er.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:37.054268  429844 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:58:37.056320  429844 out.go:177] * Starting control plane node force-systemd-env-20210813205836-393438 in cluster force-systemd-env-20210813205836-393438

	I0813 20:58:37.056345  429844 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:58:37.056422  429844 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4

	I0813 20:58:37.056447  429844 cache.go:56] Caching tarball of preloaded images

	I0813 20:58:37.056610  429844 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:58:37.056638  429844 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on containerd

	I0813 20:58:37.056768  429844 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/config.json ...

	I0813 20:58:37.056798  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/config.json: {Name:mk2424ff0b393a5833d75487ec48825d62c046b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:37.056936  429844 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:58:37.056960  429844 start.go:313] acquiring machines lock for force-systemd-env-20210813205836-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:58:37.057007  429844 start.go:317] acquired machines lock for "force-systemd-env-20210813205836-393438" in 32.17µs

	I0813 20:58:37.057028  429844 start.go:89] Provisioning new machine with config: &{Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo

nfig:{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 20:58:37.057090  429844 start.go:126] createHost starting for "" (driver="kvm2")

	I0813 20:58:40.245466  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.1.0: (9.240993229s)

	I0813 20:58:40.245499  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 from cache

	I0813 20:58:40.245526  429197 containerd.go:280] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:40.245576  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:37.059284  429844 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0813 20:58:37.059435  429844 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:37.059476  429844 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:37.071815  429844 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:44353

	I0813 20:58:37.072267  429844 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:37.072895  429844 main.go:130] libmachine: Using API Version  1

	I0813 20:58:37.072918  429844 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:37.073296  429844 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:37.073509  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetMachineName

	I0813 20:58:37.073656  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .DriverName

	I0813 20:58:37.073822  429844 start.go:160] libmachine.API.Create for "force-systemd-env-20210813205836-393438" (driver="kvm2")

	I0813 20:58:37.073856  429844 client.go:168] LocalClient.Create starting

	I0813 20:58:37.073888  429844 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem

	I0813 20:58:37.073915  429844 main.go:130] libmachine: Decoding PEM data...

	I0813 20:58:37.073935  429844 main.go:130] libmachine: Parsing certificate...

	I0813 20:58:37.074104  429844 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem

	I0813 20:58:37.074133  429844 main.go:130] libmachine: Decoding PEM data...

	I0813 20:58:37.074148  429844 main.go:130] libmachine: Parsing certificate...

	I0813 20:58:37.074201  429844 main.go:130] libmachine: Running pre-create checks...

	I0813 20:58:37.074216  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .PreCreateCheck

	I0813 20:58:37.074534  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetConfigRaw

	I0813 20:58:37.075075  429844 main.go:130] libmachine: Creating machine...

	I0813 20:58:37.075104  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .Create

	I0813 20:58:37.075246  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating KVM machine...

	I0813 20:58:37.078160  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | found existing default KVM network

	I0813 20:58:37.080000  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.079830  429868 network.go:240] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:1d:ff:3c}}

	I0813 20:58:37.080866  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.080772  429868 network.go:240] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:fc:46:2e}}

	I0813 20:58:37.081886  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.081803  429868 network.go:240] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:ee:b4:07}}

	I0813 20:58:37.083003  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.082914  429868 network.go:240] skipping subnet 192.168.72.0/24 that is taken: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 Interface:{IfaceName:virbr4 IfaceIPv4:192.168.72.1 IfaceMTU:1500 IfaceMAC:52:54:00:93:d0:b0}}

	I0813 20:58:37.085530  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.085420  429868 network.go:288] reserving subnet 192.168.83.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.83.0:0xc0000be0a8] misses:0}

	I0813 20:58:37.085577  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.085460  429868 network.go:235] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0813 20:58:37.113053  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | trying to create private KVM network mk-force-systemd-env-20210813205836-393438 192.168.83.0/24...

	I0813 20:58:37.387280  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | private KVM network mk-force-systemd-env-20210813205836-393438 192.168.83.0/24 created

	I0813 20:58:37.387319  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting up store path in /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 ...

	I0813 20:58:37.387343  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.387269  429868 common.go:108] Making disk image using store path: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.387370  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Building disk image from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso

	I0813 20:58:37.394836  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Downloading /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso...

	I0813 20:58:37.595803  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.595655  429868 common.go:115] Creating ssh key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438/id_rsa...

	I0813 20:58:37.683222  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.683102  429868 common.go:121] Creating raw disk image: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438/force-systemd-env-20210813205836-393438.rawdisk...

	I0813 20:58:37.683254  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Writing magic tar header

	I0813 20:58:37.683270  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Writing SSH key tar header

	I0813 20:58:37.683287  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.683226  429868 common.go:135] Fixing permissions on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 ...

	I0813 20:58:37.683364  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438

	I0813 20:58:37.683421  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 (perms=drwx------)

	I0813 20:58:37.683459  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines

	I0813 20:58:37.683476  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines (perms=drwxr-xr-x)

	I0813 20:58:37.683518  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.683542  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337

	I0813 20:58:37.683563  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube (perms=drwxr-xr-x)

	I0813 20:58:37.683583  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337 (perms=drwxr-xr-x)

	I0813 20:58:37.683607  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxr-xr-x)

	I0813 20:58:37.683631  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0813 20:58:37.683641  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating domain...

	I0813 20:58:37.683658  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0813 20:58:37.683668  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins

	I0813 20:58:37.683680  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home

	I0813 20:58:37.683693  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Skipping /home - not owner

	I0813 20:58:37.705670  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:f8:d3:f1 in network default

	I0813 20:58:37.706154  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring networks are active...

	I0813 20:58:37.706184  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:37.708124  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring network default is active

	I0813 20:58:37.708535  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring network mk-force-systemd-env-20210813205836-393438 is active

	I0813 20:58:37.709174  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Getting domain xml...

	I0813 20:58:37.711001  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating domain...

	I0813 20:58:38.127750  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Waiting to get IP...

	I0813 20:58:38.128819  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.129396  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.129460  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.129376  429868 retry.go:31] will retry after 263.082536ms: waiting for machine to come up

	I0813 20:58:38.393943  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.394483  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.394517  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.394426  429868 retry.go:31] will retry after 381.329545ms: waiting for machine to come up

	I0813 20:58:38.777141  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.777637  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.777673  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.777573  429868 retry.go:31] will retry after 422.765636ms: waiting for machine to come up

	I0813 20:58:39.202079  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.202628  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.202689  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:39.202573  429868 retry.go:31] will retry after 473.074753ms: waiting for machine to come up

	I0813 20:58:39.677262  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.677759  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.677907  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:39.677815  429868 retry.go:31] will retry after 587.352751ms: waiting for machine to come up

	I0813 20:58:40.266574  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:40.267149  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:40.267187  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:40.267073  429868 retry.go:31] will retry after 834.206799ms: waiting for machine to come up

	I0813 20:58:41.102502  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.103078  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.103108  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:41.103009  429868 retry.go:31] will retry after 746.553905ms: waiting for machine to come up

	I0813 20:58:41.851012  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.851569  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.851607  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:41.851526  429868 retry.go:31] will retry after 987.362415ms: waiting for machine to come up

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	33fae69af6bcf       6e38f40d628db       17 seconds ago       Exited              storage-provisioner       0                   76aee79f917be

	b6372d9d76486       296a6d5035e2d       32 seconds ago       Running             coredns                   1                   cfc4c8785e479

	afabb5f130410       0369cf4303ffd       33 seconds ago       Running             etcd                      1                   3f41ec729ef71

	57f3f32f280d8       bc2bb319a7038       33 seconds ago       Running             kube-controller-manager   1                   ce1823a3db17a

	1053b5b4ba3ab       3d174f00aa39e       33 seconds ago       Running             kube-apiserver            1                   a655f217cf1c5

	0d1a942c8b8c2       adb2816ea823a       34 seconds ago       Running             kube-proxy                1                   47e050012dbca

	1d84b053549cf       6be0dc1302e30       34 seconds ago       Running             kube-scheduler            1                   53f314c6cf963

	1bba0d6deb033       adb2816ea823a       About a minute ago   Exited              kube-proxy                0                   3f6f239c2851f

	63c0cc1fc4c0c       296a6d5035e2d       About a minute ago   Exited              coredns                   0                   b1f1f31f28005

	698bbea7ce6e9       6be0dc1302e30       About a minute ago   Exited              kube-scheduler            0                   5a66336a35add

	df02c38abac90       0369cf4303ffd       About a minute ago   Exited              etcd                      0                   4cf745987f602

	68bad43283064       bc2bb319a7038       About a minute ago   Exited              kube-controller-manager   0                   5340b4aa5ca39

	11c2753c9a8a7       3d174f00aa39e       About a minute ago   Exited              kube-apiserver            0                   304b611d719ea

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:58:44 UTC. --

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.078142311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:etcd-pause-20210813205520-393438,Uid:86a000e5c08d32d80b2fd4e89cd34dd1,Namespace:kube-system,Attempt:1,} returns sandbox id \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.145266794Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for container &ContainerMetadata{Name:etcd,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.321521915Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\" returns successfully"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.349622186Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for &ContainerMetadata{Name:etcd,Attempt:1,} returns container id \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.353268082Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.376810925Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-558bd4d5db-jzmnb,Uid:ea00ae4c-f4d9-414c-8762-6314a96c8a06,Namespace:kube-system,Attempt:1,} returns sandbox id \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.451595226Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for container &ContainerMetadata{Name:coredns,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.633919582Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for &ContainerMetadata{Name:coredns,Attempt:1,} returns container id \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.635324605Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.770314446Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.016041628Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.229109322Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\" returns successfully"

	Aug 13 20:58:15 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:15.472167045Z" level=info msg="StartContainer for \"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5\" returns successfully"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.856093567Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,}"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.901091488Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a pid=4886

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.481756294Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,} returns sandbox id \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.492027606Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.607213854Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.614295374Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.876068804Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\" returns successfully"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.156236073Z" level=info msg="Finish piping stderr of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.158102368Z" level=info msg="Finish piping stdout of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.159567062Z" level=info msg="TaskExit event &TaskExit{ContainerID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,Pid:4945,ExitStatus:255,ExitedAt:2021-08-13 20:58:41.157732657 +0000 UTC,XXX_unrecognized:[],}"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217770540Z" level=info msg="shim disconnected" id=33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217941244Z" level=error msg="copy shim log" error="read /proc/self/fd/98: file already closed"

	* 

	* ==> coredns [63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I0813 20:57:49.980199       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.978) (total time: 30001ms):

	Trace[2019727887]: [30.001847928s] [30.001847928s] END

	E0813 20:57:49.980279       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.980655       1 trace.go:205] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[939984059]: [30.00501838s] [30.00501838s] END

	E0813 20:57:49.980691       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.981307       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[911902081]: [30.005916603s] [30.005916603s] END

	E0813 20:57:49.981521       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	E0813 20:58:20.310855       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:coredns" cannot list resource "services" in API group "" at the cluster scope

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	*                 "trace_clock=local"

	              on the kernel command line

	[  +0.000017] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.863604] systemd-fstab-generator[1160]: Ignoring "noauto" for root device

	[  +0.032050] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +0.917916] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=1722 comm=systemd-network

	[  +2.669268] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.

	[  +0.335717] vboxguest: loading out-of-tree module taints kernel.

	[  +0.008488] vboxguest: PCI device not found, probably running on physical hardware.

	[Aug13 20:56] systemd-fstab-generator[2101]: Ignoring "noauto" for root device

	[  +0.927578] systemd-fstab-generator[2132]: Ignoring "noauto" for root device

	[  +0.140064] systemd-fstab-generator[2146]: Ignoring "noauto" for root device

	[  +0.195734] systemd-fstab-generator[2179]: Ignoring "noauto" for root device

	[  +8.321149] systemd-fstab-generator[2386]: Ignoring "noauto" for root device

	[Aug13 20:57] systemd-fstab-generator[2823]: Ignoring "noauto" for root device

	[ +16.072552] kauditd_printk_skb: 38 callbacks suppressed

	[ +34.372009] kauditd_printk_skb: 116 callbacks suppressed

	[  +3.958113] NFSD: Unable to end grace period: -110

	[Aug13 20:58] systemd-fstab-generator[3706]: Ignoring "noauto" for root device

	[  +0.206181] systemd-fstab-generator[3719]: Ignoring "noauto" for root device

	[  +0.261980] systemd-fstab-generator[3744]: Ignoring "noauto" for root device

	[ +19.584639] kauditd_printk_skb: 41 callbacks suppressed

	[  +5.482860] systemd-fstab-generator[4981]: Ignoring "noauto" for root device

	[  +0.846439] systemd-fstab-generator[5035]: Ignoring "noauto" for root device

	* 

	* ==> etcd [afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5] <==

	* 2021-08-13 20:58:16.461857 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true " with result "range_response_count:0 size:5" took too long (198.960862ms) to execute

	2021-08-13 20:58:16.462013 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 " with result "range_response_count:0 size:5" took too long (199.025411ms) to execute

	2021-08-13 20:58:16.462116 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (190.42222ms) to execute

	2021-08-13 20:58:16.462337 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (179.184455ms) to execute

	2021-08-13 20:58:16.462702 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (172.711746ms) to execute

	2021-08-13 20:58:16.462925 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (170.528555ms) to execute

	2021-08-13 20:58:16.463221 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (158.293847ms) to execute

	2021-08-13 20:58:16.463747 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (158.490371ms) to execute

	2021-08-13 20:58:16.464124 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (152.464331ms) to execute

	2021-08-13 20:58:16.477058 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (151.343452ms) to execute

	2021-08-13 20:58:16.478005 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" count_only:true " with result "range_response_count:0 size:5" took too long (142.028022ms) to execute

	2021-08-13 20:58:16.478939 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" limit:10000 " with result "range_response_count:0 size:5" took too long (142.259692ms) to execute

	2021-08-13 20:58:16.479721 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (129.328346ms) to execute

	2021-08-13 20:58:16.479967 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (126.882803ms) to execute

	2021-08-13 20:58:16.480303 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:10000 " with result "range_response_count:11 size:5977" took too long (116.866258ms) to execute

	2021-08-13 20:58:16.480852 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true " with result "range_response_count:0 size:7" took too long (116.970061ms) to execute

	2021-08-13 20:58:23.354247 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/cluster-admin\" " with result "range_response_count:1 size:718" took too long (1.914180768s) to execute

	2021-08-13 20:58:23.356685 W | etcdserver: request "header:<ID:14244176716868856811 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" value_size:717 lease:5020804680014080881 >> failure:<>>" with result "size:16" took too long (1.23562281s) to execute

	2021-08-13 20:58:23.370142 W | wal: sync duration of 1.250273887s, expected less than 1s

	2021-08-13 20:58:23.370676 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.152835664s) to execute

	2021-08-13 20:58:23.371565 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.728436243s) to execute

	2021-08-13 20:58:23.371769 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.847351028s) to execute

	2021-08-13 20:58:23.378962 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-558bd4d5db-jzmnb\" " with result "range_response_count:1 size:4862" took too long (671.753147ms) to execute

	2021-08-13 20:58:24.705568 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:1 size:4394" took too long (221.501911ms) to execute

	2021-08-13 20:58:26.341296 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418] <==

	* 2021-08-13 20:56:51.867973 I | embed: serving client requests on 192.168.61.151:2379

	2021-08-13 20:56:51.875825 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:57:01.271062 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpointslicemirroring-controller\" " with result "range_response_count:0 size:5" took too long (480.2351ms) to execute

	2021-08-13 20:57:01.272131 W | etcdserver: read-only range request "key:\"/registry/minions/pause-20210813205520-393438\" " with result "range_response_count:1 size:3758" took too long (875.676682ms) to execute

	2021-08-13 20:57:01.273551 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f12dc\" " with result "range_response_count:1 size:735" took too long (792.283833ms) to execute

	2021-08-13 20:57:02.171621 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (872.818648ms) to execute

	2021-08-13 20:57:02.172160 W | etcdserver: request "header:<ID:14244176716848216677 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:222 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3993 >> failure:<request_range:<key:\"/registry/minions/pause-20210813205520-393438\" > >>" with result "size:16" took too long (128.660032ms) to execute

	2021-08-13 20:57:02.172330 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:351" took too long (871.615956ms) to execute

	2021-08-13 20:57:02.172733 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f2f58\" " with result "range_response_count:1 size:733" took too long (859.92991ms) to execute

	2021-08-13 20:57:02.172849 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (853.236151ms) to execute

	2021-08-13 20:57:09.290631 W | etcdserver: request "header:<ID:14244176716848216792 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:0 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3277 >> failure:<>>" with result "size:5" took too long (472.704737ms) to execute

	2021-08-13 20:57:09.291659 W | etcdserver: read-only range request "key:\"/registry/leases/kube-node-lease/pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (897.879132ms) to execute

	2021-08-13 20:57:09.298807 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-pause-20210813205520-393438\" " with result "range_response_count:1 size:4986" took too long (528.421007ms) to execute

	2021-08-13 20:57:09.299124 W | etcdserver: read-only range request "key:\"/registry/csinodes/pause-20210813205520-393438\" " with result "range_response_count:1 size:656" took too long (894.254864ms) to execute

	2021-08-13 20:57:13.314052 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" " with result "range_response_count:1 size:210" took too long (127.466898ms) to execute

	2021-08-13 20:57:13.314663 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (132.387511ms) to execute

	2021-08-13 20:57:16.343764 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:20.988739 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:30.989151 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:39.442816 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:422" took too long (120.094417ms) to execute

	2021-08-13 20:57:40.988900 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:50.989064 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:58:00.244154 W | etcdserver: request "header:<ID:14244176716848217456 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.61.151\" mod_revision:483 > success:<request_put:<key:\"/registry/masterleases/192.168.61.151\" value_size:69 lease:5020804679993441646 >> failure:<request_range:<key:\"/registry/masterleases/192.168.61.151\" > >>" with result "size:16" took too long (162.220853ms) to execute

	2021-08-13 20:58:00.245134 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (881.389444ms) to execute

	2021-08-13 20:58:00.989778 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:58:54 up 3 min,  0 users,  load average: 1.49, 0.89, 0.36

	Linux pause-20210813205520-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c] <==

	* I0813 20:58:20.351321       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 20:58:20.372737       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 20:58:20.375890       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 20:58:20.387225       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 20:58:20.401103       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:58:20.403283       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 20:58:20.407207       1 cache.go:39] Caches are synced for autoregister controller

	I0813 20:58:20.410957       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 20:58:21.065658       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 20:58:21.066635       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 20:58:21.090819       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 20:58:23.358425       1 trace.go:205] Trace[1442514083]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.628) (total time: 1729ms):

	Trace[1442514083]: ---"Object stored in database" 1729ms (20:58:00.358)

	Trace[1442514083]: [1.729557914s] [1.729557914s] END

	I0813 20:58:23.359893       1 trace.go:205] Trace[553017594]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/cluster-admin,user-agent:kube-apiserver/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.438) (total time: 1920ms):

	Trace[553017594]: ---"About to write a response" 1919ms (20:58:00.358)

	Trace[553017594]: [1.920866407s] [1.920866407s] END

	I0813 20:58:23.381663       1 trace.go:205] Trace[1143050190]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-jzmnb,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:22.699) (total time: 682ms):

	Trace[1143050190]: ---"About to write a response" 681ms (20:58:00.380)

	Trace[1143050190]: [682.310081ms] [682.310081ms] END

	I0813 20:58:25.230359       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 20:58:25.281700       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 20:58:25.373725       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0813 20:58:25.413105       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:58:25.560667       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io

	* 

	* ==> kube-apiserver [11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016] <==

	* I0813 20:57:09.309542       1 trace.go:205] Trace[2046907584]: "Create" url:/api/v1/nodes,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.501) (total time: 806ms):

	Trace[2046907584]: [806.482297ms] [806.482297ms] END

	I0813 20:57:09.310802       1 trace.go:205] Trace[146959614]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.771) (total time: 538ms):

	Trace[146959614]: ---"Object stored in database" 538ms (20:57:00.310)

	Trace[146959614]: [538.954794ms] [538.954794ms] END

	I0813 20:57:09.311138       1 trace.go:205] Trace[1128950750]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-pause-20210813205520-393438,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1128950750]: ---"About to write a response" 537ms (20:57:00.307)

	Trace[1128950750]: [541.267103ms] [541.267103ms] END

	I0813 20:57:09.311248       1 trace.go:205] Trace[1268223707]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1268223707]: ---"Object stored in database" 540ms (20:57:00.310)

	Trace[1268223707]: [541.971563ms] [541.971563ms] END

	I0813 20:57:09.311433       1 trace.go:205] Trace[1977445463]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.772) (total time: 538ms):

	Trace[1977445463]: ---"Object stored in database" 537ms (20:57:00.310)

	Trace[1977445463]: [538.348208ms] [538.348208ms] END

	I0813 20:57:09.321803       1 trace.go:205] Trace[494614999]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 552ms):

	Trace[494614999]: [552.453895ms] [552.453895ms] END

	I0813 20:57:09.345220       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:57:16.259955       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	I0813 20:57:16.380865       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0813 20:57:37.272234       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:57:37.272418       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:57:37.272507       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:58:00.246413       1 trace.go:205] Trace[1997979141]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (13-Aug-2021 20:57:59.258) (total time: 987ms):

	Trace[1997979141]: ---"Transaction committed" 984ms (20:58:00.246)

	Trace[1997979141]: [987.521712ms] [987.521712ms] END

	* 

	* ==> kube-controller-manager [57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849] <==

	* I0813 20:58:25.074041       1 daemon_controller.go:285] Starting daemon sets controller

	I0813 20:58:25.074050       1 shared_informer.go:240] Waiting for caches to sync for daemon sets

	I0813 20:58:25.116517       1 controllermanager.go:574] Started "horizontalpodautoscaling"

	I0813 20:58:25.116556       1 horizontal.go:169] Starting HPA controller

	I0813 20:58:25.116758       1 shared_informer.go:240] Waiting for caches to sync for HPA

	E0813 20:58:25.120839       1 core.go:91] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail

	W0813 20:58:25.120857       1 controllermanager.go:566] Skipping "service"

	I0813 20:58:25.124370       1 controllermanager.go:574] Started "persistentvolume-expander"

	I0813 20:58:25.124569       1 expand_controller.go:327] Starting expand controller

	I0813 20:58:25.124579       1 shared_informer.go:240] Waiting for caches to sync for expand

	I0813 20:58:25.175876       1 controllermanager.go:574] Started "namespace"

	I0813 20:58:25.176251       1 namespace_controller.go:200] Starting namespace controller

	I0813 20:58:25.176376       1 shared_informer.go:240] Waiting for caches to sync for namespace

	I0813 20:58:25.185657       1 controllermanager.go:574] Started "serviceaccount"

	I0813 20:58:25.187325       1 serviceaccounts_controller.go:117] Starting service account controller

	I0813 20:58:25.187340       1 shared_informer.go:240] Waiting for caches to sync for service account

	I0813 20:58:25.192151       1 controllermanager.go:574] Started "replicaset"

	I0813 20:58:25.192315       1 replica_set.go:182] Starting replicaset controller

	I0813 20:58:25.192327       1 shared_informer.go:240] Waiting for caches to sync for ReplicaSet

	I0813 20:58:25.200141       1 controllermanager.go:574] Started "bootstrapsigner"

	I0813 20:58:25.200611       1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer

	I0813 20:58:25.204061       1 controllermanager.go:574] Started "cronjob"

	I0813 20:58:25.204578       1 cronjob_controllerv2.go:125] Starting cronjob controller v2

	I0813 20:58:25.204590       1 shared_informer.go:240] Waiting for caches to sync for cronjob

	I0813 20:58:25.207401       1 node_ipam_controller.go:91] Sending events to api server.

	* 

	* ==> kube-controller-manager [68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8] <==

	* I0813 20:57:15.593972       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:57:15.593991       1 disruption.go:371] Sending events to api server.

	I0813 20:57:15.596695       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:57:15.636700       1 shared_informer.go:247] Caches are synced for service account 

	I0813 20:57:15.652896       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:57:15.701400       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:57:15.701628       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:57:15.701702       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:57:15.701748       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:57:15.701825       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:57:15.702024       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	I0813 20:57:15.735577       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0813 20:57:15.751667       1 shared_informer.go:247] Caches are synced for stateful set 

	I0813 20:57:15.767285       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:15.796364       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:57:15.847876       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:16.199991       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.200121       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:57:16.224599       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.277997       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:57:16.457337       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-mlf5c"

	I0813 20:57:16.545672       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-fhxw7"

	I0813 20:57:16.596799       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-jzmnb"

	I0813 20:57:16.804186       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:57:16.819742       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-fhxw7"

	* 

	* ==> kube-proxy [0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5] <==

	* E0813 20:58:20.334846       1 node.go:161] Failed to retrieve node info: nodes "pause-20210813205520-393438" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I0813 20:58:21.364522       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:58:21.365223       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:58:21.366125       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:58:23.461362       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:58:23.462248       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:58:23.465333       1 server_others.go:212] Using iptables Proxier.

	I0813 20:58:23.483125       1 server.go:643] Version: v1.21.3

	I0813 20:58:23.488959       1 config.go:315] Starting service config controller

	I0813 20:58:23.490323       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:58:23.490593       1 config.go:224] Starting endpoint slice config controller

	I0813 20:58:23.490606       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:58:23.512424       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:58:23.514744       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:58:23.591163       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:58:23.593313       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62] <==

	* I0813 20:57:20.123665       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:57:20.123841       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:57:20.123909       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:57:20.180054       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:57:20.180158       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:57:20.180173       1 server_others.go:212] Using iptables Proxier.

	I0813 20:57:20.181825       1 server.go:643] Version: v1.21.3

	I0813 20:57:20.184367       1 config.go:315] Starting service config controller

	I0813 20:57:20.184561       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:57:20.184600       1 config.go:224] Starting endpoint slice config controller

	I0813 20:57:20.184604       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:57:20.203222       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:57:20.207174       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:57:20.285130       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:57:20.285144       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c] <==

	* I0813 20:58:11.830530       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:58:20.220887       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:58:20.224373       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:58:20.224624       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:58:20.224640       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:58:20.341243       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:58:20.343223       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.343608       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.347257       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:58:20.444874       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889] <==

	* I0813 20:56:57.340096       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:56:57.373873       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:57.375600       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:57.398047       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:57.406392       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:56:57.418940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.424521       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:57.426539       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:56:57.426578       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:56:57.428616       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428765       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:56:57.428811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:57.428897       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:56:58.261670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:58.311937       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:58.405804       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.463800       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:58.585826       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.615525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:58.626736       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.669986       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:58.791820       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0813 20:57:01.440271       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:58:55 UTC. --

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.453957    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454194    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454410    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454727    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454757    2832 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.611414    2832 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210813205520-393438.169af943ec02b0a4", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210813205520-393438", UID:"36ca0d21ef43020c8f018e62049ff15f", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readines

s probe failed: Get \"https://192.168.61.151:8443/readyz\": dial tcp 192.168.61.151:8443: connect: connection refused", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210813205520-393438"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.61.151:8443: connect: connection refused'(may retry after sleeping)

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.428873    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429203    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429890    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430165    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430396    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:10.430620    2832 controller.go:114] failed to update lease using latest lease, fallback to ensure lease, err: failed 5 attempts to update lease

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430883    2832 controller.go:144] failed to ensure lease exists, will retry in 200ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.632976    2832 controller.go:144] failed to ensure lease exists, will retry in 400ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:11.038724    2832 controller.go:144] failed to ensure lease exists, will retry in 800ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:11.294567    2832 status_manager.go:566] "Failed to get status for pod" podUID=469cea0375ae276925a50e4dde7e4ace pod="kube-system/kube-scheduler-pause-20210813205520-393438" error="Get \"https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-pause-20210813205520-393438\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.266431    2832 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.269986    2832 reflector.go:138] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.541317    2832 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590904    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6vd\" (UniqueName: \"kubernetes.io/projected/99920d7c-bb8d-4c65-bf44-b56f23a40e53-kube-api-access-xw6vd\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590979    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/99920d7c-bb8d-4c65-bf44-b56f23a40e53-tmp\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:29 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:29.362225    2832 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: kubelet.service: Succeeded.

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81] <==

	* 	/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:880 +0x4af

	goroutine 90 [sync.Cond.Wait]:

	sync.runtime_notifyListWait(0xc000328290, 0xc000000003)

		/usr/local/go/src/runtime/sema.go:513 +0xf8

	sync.(*Cond).Wait(0xc000328280)

		/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0003f0480, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003bcc80, 0x18e5530, 0xc0003284c0, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004ceee0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0004ceee0, 0x18b3d60, 0xc000311f80, 0x1, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004ceee0, 0x3b9aca00, 0x0, 0x17a0501, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc0004ceee0, 0x3b9aca00, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

-- /stdout --

** stderr ** 

	E0813 20:58:54.644106  430035 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:250: failed logs error: exit status 110

--- FAIL: TestPause/serial/Pause (26.42s)

=== RUN   TestPause/serial/VerifyStatus

status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p pause-20210813205520-393438 --output=json --layout=cluster

status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-20210813205520-393438 --output=json --layout=cluster: exit status 2 (299.193802ms)

-- stdout --

	{"Name":"pause-20210813205520-393438","StatusCode":101,"StatusName":"Pausing","Step":"Pausing","StepDetail":"* Pausing node pause-20210813205520-393438 ...","BinaryVersion":"v1.22.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-20210813205520-393438","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr ** 

	E0813 20:58:55.535833  430187 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

	E0813 20:58:55.535871  430187 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

	E0813 20:58:55.535899  430187 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

** /stderr **

pause_test.go:190: incorrect status code: 101

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (280.883469ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/VerifyStatus FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/VerifyStatus]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25

=== CONT  TestPause/serial/VerifyStatus

helpers_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25: exit status 110 (18.461132777s)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                   Args                   |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:30:34 UTC | Fri, 13 Aug 2021 20:31:44 UTC |

	|         | node start m03                           |                                          |         |         |                               |                               |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	| stop    | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:31:45 UTC | Fri, 13 Aug 2021 20:34:51 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:34:51 UTC | Fri, 13 Aug 2021 20:40:57 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:40:58 UTC | Fri, 13 Aug 2021 20:40:59 UTC |

	|         | node delete m03                          |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:41:00 UTC | Fri, 13 Aug 2021 20:44:04 UTC |

	|         | stop                                     |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:44:04 UTC | Fri, 13 Aug 2021 20:48:01 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr --driver=kvm2          |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:48:01 UTC | Fri, 13 Aug 2021 20:49:01 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:02 UTC | Fri, 13 Aug 2021 20:49:03 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:03 UTC | Fri, 13 Aug 2021 20:49:05 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:50:38 UTC | Fri, 13 Aug 2021 20:52:46 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | --wait=true --preload=false              |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:47 UTC | Fri, 13 Aug 2021 20:52:48 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl pull busybox              |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:48 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=kvm2           |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl image ls                  |                                          |         |         |                               |                               |

	| delete  | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:41 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	| start   | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:41 UTC | Fri, 13 Aug 2021 20:54:41 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --memory=2048 --driver=kvm2              |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:42 UTC | Fri, 13 Aug 2021 20:54:42 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --cancel-scheduled                       |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:55 UTC | Fri, 13 Aug 2021 20:55:02 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --schedule 5s                            |                                          |         |         |                               |                               |

	| delete  | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:20 UTC | Fri, 13 Aug 2021 20:55:20 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	| start   | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:33 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048     |                                          |         |         |                               |                               |

	|         | --wait=true --driver=kvm2                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:33 UTC | Fri, 13 Aug 2021 20:57:35 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:54 UTC |

	|         | --memory=2048                            |                                          |         |         |                               |                               |

	|         | --install-addons=false                   |                                          |         |         |                               |                               |

	|         | --wait=all --driver=kvm2                 |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:54 UTC | Fri, 13 Aug 2021 20:58:28 UTC |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:27 UTC | Fri, 13 Aug 2021 20:58:34 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| logs    | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:34 UTC | Fri, 13 Aug 2021 20:58:35 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| delete  | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:35 UTC | Fri, 13 Aug 2021 20:58:36 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:58:36

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:58:36.952203  429844 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:58:36.952268  429844 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:36.952271  429844 out.go:311] Setting ErrFile to fd 2...

	I0813 20:58:36.952274  429844 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:58:36.952377  429844 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:58:36.952620  429844 out.go:305] Setting JSON to false

	I0813 20:58:36.993458  429844 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":6079,"bootTime":1628882238,"procs":193,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:58:36.993602  429844 start.go:121] virtualization: kvm guest

	I0813 20:58:36.996289  429844 out.go:177] * [force-systemd-env-20210813205836-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:58:36.998267  429844 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:36.996433  429844 notify.go:169] Checking for updates...

	I0813 20:58:36.999665  429844 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:58:37.001250  429844 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.002637  429844 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:58:37.004247  429844 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0813 20:58:37.004726  429844 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:58:37.004843  429844 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:58:37.004926  429844 config.go:177] Loaded profile config "running-upgrade-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I0813 20:58:37.004973  429844 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:58:37.038645  429844 out.go:177] * Using the kvm2 driver based on user configuration

	I0813 20:58:37.038692  429844 start.go:278] selected driver: kvm2

	I0813 20:58:37.038699  429844 start.go:751] validating driver "kvm2" against <nil>

	I0813 20:58:37.038719  429844 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:58:37.039903  429844 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:58:37.040054  429844 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:58:37.053876  429844 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:58:37.053933  429844 start_flags.go:263] no existing cluster config was found, will generate one from the flags 

	I0813 20:58:37.054106  429844 start_flags.go:679] Wait components to verify : map[apiserver:true system_pods:true]

	I0813 20:58:37.054129  429844 cni.go:93] Creating CNI manager for ""

	I0813 20:58:37.054137  429844 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:37.054146  429844 start_flags.go:272] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0813 20:58:37.054157  429844 start_flags.go:277] config:

	{Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clust

er.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:37.054268  429844 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:58:37.056320  429844 out.go:177] * Starting control plane node force-systemd-env-20210813205836-393438 in cluster force-systemd-env-20210813205836-393438

	I0813 20:58:37.056345  429844 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:58:37.056422  429844 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4

	I0813 20:58:37.056447  429844 cache.go:56] Caching tarball of preloaded images

	I0813 20:58:37.056610  429844 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:58:37.056638  429844 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on containerd

	I0813 20:58:37.056768  429844 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/config.json ...

	I0813 20:58:37.056798  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/config.json: {Name:mk2424ff0b393a5833d75487ec48825d62c046b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:37.056936  429844 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:58:37.056960  429844 start.go:313] acquiring machines lock for force-systemd-env-20210813205836-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:58:37.057007  429844 start.go:317] acquired machines lock for "force-systemd-env-20210813205836-393438" in 32.17µs

	I0813 20:58:37.057028  429844 start.go:89] Provisioning new machine with config: &{Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo

nfig:{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 20:58:37.057090  429844 start.go:126] createHost starting for "" (driver="kvm2")

	I0813 20:58:40.245466  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.1.0: (9.240993229s)

	I0813 20:58:40.245499  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 from cache

	I0813 20:58:40.245526  429197 containerd.go:280] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:40.245576  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I0813 20:58:37.059284  429844 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0813 20:58:37.059435  429844 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:37.059476  429844 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:37.071815  429844 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:44353

	I0813 20:58:37.072267  429844 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:37.072895  429844 main.go:130] libmachine: Using API Version  1

	I0813 20:58:37.072918  429844 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:37.073296  429844 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:37.073509  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetMachineName

	I0813 20:58:37.073656  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .DriverName

	I0813 20:58:37.073822  429844 start.go:160] libmachine.API.Create for "force-systemd-env-20210813205836-393438" (driver="kvm2")

	I0813 20:58:37.073856  429844 client.go:168] LocalClient.Create starting

	I0813 20:58:37.073888  429844 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem

	I0813 20:58:37.073915  429844 main.go:130] libmachine: Decoding PEM data...

	I0813 20:58:37.073935  429844 main.go:130] libmachine: Parsing certificate...

	I0813 20:58:37.074104  429844 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem

	I0813 20:58:37.074133  429844 main.go:130] libmachine: Decoding PEM data...

	I0813 20:58:37.074148  429844 main.go:130] libmachine: Parsing certificate...

	I0813 20:58:37.074201  429844 main.go:130] libmachine: Running pre-create checks...

	I0813 20:58:37.074216  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .PreCreateCheck

	I0813 20:58:37.074534  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetConfigRaw

	I0813 20:58:37.075075  429844 main.go:130] libmachine: Creating machine...

	I0813 20:58:37.075104  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .Create

	I0813 20:58:37.075246  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating KVM machine...

	I0813 20:58:37.078160  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | found existing default KVM network

	I0813 20:58:37.080000  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.079830  429868 network.go:240] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:1d:ff:3c}}

	I0813 20:58:37.080866  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.080772  429868 network.go:240] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:fc:46:2e}}

	I0813 20:58:37.081886  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.081803  429868 network.go:240] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:ee:b4:07}}

	I0813 20:58:37.083003  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.082914  429868 network.go:240] skipping subnet 192.168.72.0/24 that is taken: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 Interface:{IfaceName:virbr4 IfaceIPv4:192.168.72.1 IfaceMTU:1500 IfaceMAC:52:54:00:93:d0:b0}}

	I0813 20:58:37.085530  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.085420  429868 network.go:288] reserving subnet 192.168.83.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.83.0:0xc0000be0a8] misses:0}

	I0813 20:58:37.085577  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.085460  429868 network.go:235] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0813 20:58:37.113053  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | trying to create private KVM network mk-force-systemd-env-20210813205836-393438 192.168.83.0/24...

	I0813 20:58:37.387280  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | private KVM network mk-force-systemd-env-20210813205836-393438 192.168.83.0/24 created

	I0813 20:58:37.387319  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting up store path in /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 ...

	I0813 20:58:37.387343  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.387269  429868 common.go:108] Making disk image using store path: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.387370  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Building disk image from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso

	I0813 20:58:37.394836  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Downloading /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/iso/minikube-v1.22.0-1628622362-12032.iso...

	I0813 20:58:37.595803  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.595655  429868 common.go:115] Creating ssh key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438/id_rsa...

	I0813 20:58:37.683222  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.683102  429868 common.go:121] Creating raw disk image: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438/force-systemd-env-20210813205836-393438.rawdisk...

	I0813 20:58:37.683254  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Writing magic tar header

	I0813 20:58:37.683270  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Writing SSH key tar header

	I0813 20:58:37.683287  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:37.683226  429868 common.go:135] Fixing permissions on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 ...

	I0813 20:58:37.683364  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438

	I0813 20:58:37.683421  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/force-systemd-env-20210813205836-393438 (perms=drwx------)

	I0813 20:58:37.683459  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines

	I0813 20:58:37.683476  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines (perms=drwxr-xr-x)

	I0813 20:58:37.683518  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:58:37.683542  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337

	I0813 20:58:37.683563  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube (perms=drwxr-xr-x)

	I0813 20:58:37.683583  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337 (perms=drwxr-xr-x)

	I0813 20:58:37.683607  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxr-xr-x)

	I0813 20:58:37.683631  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0813 20:58:37.683641  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating domain...

	I0813 20:58:37.683658  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0813 20:58:37.683668  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home/jenkins

	I0813 20:58:37.683680  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Checking permissions on dir: /home

	I0813 20:58:37.683693  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | Skipping /home - not owner

	I0813 20:58:37.705670  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:f8:d3:f1 in network default

	I0813 20:58:37.706154  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring networks are active...

	I0813 20:58:37.706184  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:37.708124  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring network default is active

	I0813 20:58:37.708535  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Ensuring network mk-force-systemd-env-20210813205836-393438 is active

	I0813 20:58:37.709174  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Getting domain xml...

	I0813 20:58:37.711001  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Creating domain...

	I0813 20:58:38.127750  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Waiting to get IP...

	I0813 20:58:38.128819  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.129396  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.129460  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.129376  429868 retry.go:31] will retry after 263.082536ms: waiting for machine to come up

	I0813 20:58:38.393943  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.394483  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.394517  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.394426  429868 retry.go:31] will retry after 381.329545ms: waiting for machine to come up

	I0813 20:58:38.777141  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.777637  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:38.777673  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:38.777573  429868 retry.go:31] will retry after 422.765636ms: waiting for machine to come up

	I0813 20:58:39.202079  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.202628  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.202689  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:39.202573  429868 retry.go:31] will retry after 473.074753ms: waiting for machine to come up

	I0813 20:58:39.677262  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.677759  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:39.677907  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:39.677815  429868 retry.go:31] will retry after 587.352751ms: waiting for machine to come up

	I0813 20:58:40.266574  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:40.267149  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:40.267187  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:40.267073  429868 retry.go:31] will retry after 834.206799ms: waiting for machine to come up

	I0813 20:58:41.102502  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.103078  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.103108  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:41.103009  429868 retry.go:31] will retry after 746.553905ms: waiting for machine to come up

	I0813 20:58:41.851012  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.851569  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:41.851607  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:41.851526  429868 retry.go:31] will retry after 987.362415ms: waiting for machine to come up

	I0813 20:58:43.969399  429159 out.go:204]   - Configuring RBAC rules ...

	I0813 20:58:44.522081  429159 cni.go:93] Creating CNI manager for ""

	I0813 20:58:44.522110  429159 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:44.523838  429159 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0813 20:58:44.523926  429159 ssh_runner.go:149] Run: sudo mkdir -p /etc/cni/net.d

	I0813 20:58:44.537355  429159 ssh_runner.go:316] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0813 20:58:44.558964  429159 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 20:58:44.559026  429159 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:58:44.559034  429159 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl label nodes minikube.k8s.io/version=v1.22.0 minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c minikube.k8s.io/name=kubernetes-upgrade-20210813205735-393438 minikube.k8s.io/updated_at=2021_08_13T20_58_44_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 20:58:44.575216  429159 ops.go:34] apiserver oom_adj: 16

	I0813 20:58:44.575231  429159 ops.go:39] adjusting apiserver oom_adj to -10

	I0813 20:58:44.575244  429159 ssh_runner.go:149] Run: /bin/bash -c "echo -10 | sudo tee /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 20:58:44.999176  429159 kubeadm.go:985] duration metric: took 440.206594ms to wait for elevateKubeSystemPrivileges.

	I0813 20:58:44.999256  429159 kubeadm.go:392] StartCluster complete in 19.130731142s

	I0813 20:58:44.999283  429159 settings.go:142] acquiring lock: {Name:mk2e042a75d7d4722d2a29030eed8e43c687ad8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:44.999382  429159 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:45.001133  429159 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:45.002169  429159 kapi.go:59] client config for kubernetes-upgrade-20210813205735-393438: &rest.Config{Host:"https://192.168.39.75:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/pro

files/kubernetes-upgrade-20210813205735-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:41.012327  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 from cache

	I0813 20:58:41.012371  429197 containerd.go:280] Loading image: /var/lib/minikube/images/coredns_1.7.0

	I0813 20:58:41.012422  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0

	I0813 20:58:41.782348  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 from cache

	I0813 20:58:41.782394  429197 containerd.go:280] Loading image: /var/lib/minikube/images/kube-apiserver_v1.20.0

	I0813 20:58:41.782464  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0

	I0813 20:58:43.014842  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0: (1.232349741s)

	I0813 20:58:43.014872  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 from cache

	I0813 20:58:43.014894  429197 containerd.go:280] Loading image: /var/lib/minikube/images/etcd_3.4.13-0

	I0813 20:58:43.014943  429197 ssh_runner.go:149] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0

	I0813 20:58:45.560046  429159 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "kubernetes-upgrade-20210813205735-393438" rescaled to 1

	I0813 20:58:45.560108  429159 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}

	I0813 20:58:45.561738  429159 out.go:177] * Verifying Kubernetes components...

	I0813 20:58:45.561802  429159 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:58:45.560165  429159 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 20:58:45.560188  429159 addons.go:342] enableAddons start: toEnable=map[], additional=[]

	I0813 20:58:45.560387  429159 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:58:45.561900  429159 addons.go:59] Setting storage-provisioner=true in profile "kubernetes-upgrade-20210813205735-393438"

	I0813 20:58:45.561919  429159 addons.go:135] Setting addon storage-provisioner=true in "kubernetes-upgrade-20210813205735-393438"

	W0813 20:58:45.561930  429159 addons.go:147] addon storage-provisioner should already be in state true

	I0813 20:58:45.561948  429159 addons.go:59] Setting default-storageclass=true in profile "kubernetes-upgrade-20210813205735-393438"

	I0813 20:58:45.561962  429159 host.go:66] Checking if "kubernetes-upgrade-20210813205735-393438" exists ...

	I0813 20:58:45.561969  429159 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "kubernetes-upgrade-20210813205735-393438"

	I0813 20:58:45.562408  429159 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:45.562432  429159 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:45.562446  429159 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:45.562461  429159 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:45.584670  429159 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:39223

	I0813 20:58:45.585317  429159 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:45.585947  429159 main.go:130] libmachine: Using API Version  1

	I0813 20:58:45.585964  429159 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:45.586411  429159 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:45.587050  429159 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:45.587096  429159 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:45.590121  429159 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:42867

	I0813 20:58:45.590528  429159 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:45.591101  429159 main.go:130] libmachine: Using API Version  1

	I0813 20:58:45.591126  429159 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:45.591491  429159 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:45.591677  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:58:45.596447  429159 kapi.go:59] client config for kubernetes-upgrade-20210813205735-393438: &rest.Config{Host:"https://192.168.39.75:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/pro

files/kubernetes-upgrade-20210813205735-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:45.600671  429159 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:39405

	I0813 20:58:45.602172  429159 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:45.602715  429159 main.go:130] libmachine: Using API Version  1

	I0813 20:58:45.602733  429159 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:45.603159  429159 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:45.603323  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:58:45.606207  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:45.608267  429159 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:58:45.608388  429159 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:58:45.608404  429159 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 20:58:45.608425  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:45.611070  429159 addons.go:135] Setting addon default-storageclass=true in "kubernetes-upgrade-20210813205735-393438"

	W0813 20:58:45.611145  429159 addons.go:147] addon default-storageclass should already be in state true

	I0813 20:58:45.611194  429159 host.go:66] Checking if "kubernetes-upgrade-20210813205735-393438" exists ...

	I0813 20:58:45.611662  429159 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:45.611737  429159 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:45.614890  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:45.615371  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:45.615408  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:45.615631  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:45.615788  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:45.615921  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:45.616048  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:45.625461  429159 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40411

	I0813 20:58:45.625875  429159 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:45.626358  429159 main.go:130] libmachine: Using API Version  1

	I0813 20:58:45.626389  429159 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:45.626838  429159 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:45.627438  429159 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:58:45.627478  429159 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:58:45.641154  429159 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:43917

	I0813 20:58:45.641622  429159 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:58:45.642128  429159 main.go:130] libmachine: Using API Version  1

	I0813 20:58:45.642149  429159 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:58:45.642551  429159 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:58:45.642750  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:58:45.648187  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:58:45.650231  429159 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 20:58:45.650247  429159 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 20:58:45.650267  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:58:45.656254  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:45.656712  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:58:45.656739  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:58:45.656985  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:58:45.657137  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:58:45.657295  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:58:45.657419  429159 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:58:45.723001  429159 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0813 20:58:45.723863  429159 kapi.go:59] client config for kubernetes-upgrade-20210813205735-393438: &rest.Config{Host:"https://192.168.39.75:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/pro

files/kubernetes-upgrade-20210813205735-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:45.725225  429159 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:58:45.725270  429159 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:58:45.741319  429159 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:58:45.755227  429159 api_server.go:70] duration metric: took 195.080998ms to wait for apiserver process to appear ...

	I0813 20:58:45.755251  429159 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:58:45.755262  429159 api_server.go:239] Checking apiserver healthz at https://192.168.39.75:8443/healthz ...

	I0813 20:58:45.772657  429159 api_server.go:265] https://192.168.39.75:8443/healthz returned 200:

	ok

	I0813 20:58:45.773887  429159 api_server.go:139] control plane version: v1.14.0

	I0813 20:58:45.773911  429159 api_server.go:129] duration metric: took 18.650191ms to wait for apiserver health ...

	I0813 20:58:45.773922  429159 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 20:58:45.786259  429159 system_pods.go:59] 0 kube-system pods found

	I0813 20:58:45.786290  429159 retry.go:31] will retry after 305.063636ms: only 0 pod(s) have shown up

	I0813 20:58:45.816348  429159 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 20:58:46.118512  429159 system_pods.go:59] 0 kube-system pods found

	I0813 20:58:46.118603  429159 retry.go:31] will retry after 338.212508ms: only 0 pod(s) have shown up

	I0813 20:58:46.460537  429159 system_pods.go:59] 0 kube-system pods found

	I0813 20:58:46.460576  429159 retry.go:31] will retry after 378.459802ms: only 0 pod(s) have shown up

	I0813 20:58:46.543644  429159 start.go:728] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS

	I0813 20:58:46.623305  429159 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:46.623407  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Close

	I0813 20:58:46.623499  429159 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:46.623546  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Close

	I0813 20:58:46.623843  429159 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:46.623857  429159 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:46.623874  429159 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:46.623886  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Close

	I0813 20:58:46.623979  429159 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:46.623994  429159 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:46.624004  429159 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:46.624020  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Close

	I0813 20:58:46.624132  429159 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:46.624152  429159 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:46.624163  429159 main.go:130] libmachine: Making call to close driver server

	I0813 20:58:46.624172  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Close

	I0813 20:58:46.624238  429159 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Closing plugin on server side

	I0813 20:58:46.624325  429159 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:46.624348  429159 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:46.626276  429159 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:58:46.626301  429159 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:58:42.840899  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:42.841351  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:42.841377  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:42.841284  429868 retry.go:31] will retry after 1.189835008s: waiting for machine to come up

	I0813 20:58:44.032397  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:44.032978  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:44.033013  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:44.032898  429868 retry.go:31] will retry after 1.677229867s: waiting for machine to come up

	I0813 20:58:45.711875  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:45.712758  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:45.712790  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:45.712733  429868 retry.go:31] will retry after 2.346016261s: waiting for machine to come up

	I0813 20:58:46.628392  429159 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 20:58:46.628414  429159 addons.go:344] enableAddons completed in 1.068233981s

	I0813 20:58:46.852764  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:46.852801  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:46.852821  429159 retry.go:31] will retry after 469.882201ms: only 1 pod(s) have shown up

	I0813 20:58:47.327835  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:47.327870  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:47.327886  429159 retry.go:31] will retry after 667.365439ms: only 1 pod(s) have shown up

	I0813 20:58:48.000488  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:48.000521  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:48.000536  429159 retry.go:31] will retry after 597.243124ms: only 1 pod(s) have shown up

	I0813 20:58:48.602933  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:48.602976  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:48.602992  429159 retry.go:31] will retry after 789.889932ms: only 1 pod(s) have shown up

	I0813 20:58:49.397879  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:49.397919  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:49.397935  429159 retry.go:31] will retry after 951.868007ms: only 1 pod(s) have shown up

	I0813 20:58:46.988660  429197 ssh_runner.go:189] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0: (3.973686242s)

	I0813 20:58:46.988694  429197 cache_images.go:305] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 from cache

	I0813 20:58:46.988730  429197 cache_images.go:113] Successfully loaded all cached images

	I0813 20:58:46.988736  429197 cache_images.go:82] LoadImages completed in 42.290547836s

	I0813 20:58:46.988799  429197 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:58:47.022549  429197 cni.go:93] Creating CNI manager for ""

	I0813 20:58:47.022586  429197 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:58:47.022600  429197 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:58:47.022619  429197 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.177 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:running-upgrade-20210813205520-393438 NodeName:running-upgrade-20210813205520-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.177"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.72.177 CgroupDrive

r:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:58:47.022828  429197 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.72.177

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "running-upgrade-20210813205520-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.72.177

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.72.177"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:58:47.023021  429197 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=running-upgrade-20210813205520-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.177 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:58:47.023094  429197 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I0813 20:58:47.041826  429197 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:58:47.041924  429197 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:58:47.067611  429197 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (553 bytes)

	I0813 20:58:47.092063  429197 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:58:47.111889  429197 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2093 bytes)

	I0813 20:58:47.127743  429197 ssh_runner.go:149] Run: grep 192.168.72.177	control-plane.minikube.internal$ /etc/hosts

	I0813 20:58:47.133422  429197 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438 for IP: 192.168.72.177

	I0813 20:58:47.133483  429197 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:58:47.133502  429197 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:58:47.133579  429197 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/client.key

	I0813 20:58:47.133606  429197 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/apiserver.key.c6046103

	I0813 20:58:47.133630  429197 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/proxy-client.key

	I0813 20:58:47.133764  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:58:47.133809  429197 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:58:47.133819  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:58:47.133850  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:58:47.133900  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:58:47.133936  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:58:47.134002  429197 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:58:47.135352  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:58:47.158522  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:58:47.195276  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:58:47.224580  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 20:58:47.255058  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:58:47.281845  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:58:47.320022  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:58:47.363658  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:58:47.398079  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:58:47.449256  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:58:47.476708  429197 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:58:47.512052  429197 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:58:47.544298  429197 ssh_runner.go:149] Run: openssl version

	I0813 20:58:47.557596  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:58:47.585950  429197 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:47.596416  429197 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:47.596473  429197 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:58:47.607869  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:58:47.624505  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:58:47.652017  429197 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:58:47.667525  429197 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:58:47.667582  429197 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:58:47.681920  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:58:47.711458  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:58:47.725869  429197 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:58:47.737390  429197 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:58:47.737433  429197 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:58:47.750909  429197 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:58:47.767677  429197 kubeadm.go:390] StartCluster: {Name:running-upgrade-20210813205520-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName

:running-upgrade-20210813205520-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.72.177 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:58:47.767802  429197 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:58:47.767851  429197 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:47.811226  429197 cri.go:76] found id: "c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30"

	I0813 20:58:47.811254  429197 cri.go:76] found id: "e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28"

	I0813 20:58:47.811263  429197 cri.go:76] found id: "3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28"

	I0813 20:58:47.811270  429197 cri.go:76] found id: "ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1"

	I0813 20:58:47.811277  429197 cri.go:76] found id: "3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f"

	I0813 20:58:47.811283  429197 cri.go:76] found id: "1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb"

	I0813 20:58:47.811290  429197 cri.go:76] found id: "0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27"

	I0813 20:58:47.811296  429197 cri.go:76] found id: ""

	I0813 20:58:47.811346  429197 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:58:47.869131  429197 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f","pid":3066,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f/rootfs","created":"2021-08-13T20:57:54.026039347Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_11ab50e9-0e9e-4491-8ebc-67c7a715291f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b","pid":2799,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0e8921c6fa47913c43dd39c47d848e7a6

dd968b52f53d46fe799da29fd86f47b","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b/rootfs","created":"2021-08-13T20:57:49.017554987Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-n27fb_bc2792f7-9b16-46cb-935f-f338306bfa30"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27","pid":2593,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27/rootfs","created":"2021-08-13T20:57:24.380666543Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kub

ernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb","pid":2553,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb/rootfs","created":"2021-08-13T20:57:24.281917637Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b","pid":2474,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/38160f60d9

956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b/rootfs","created":"2021-08-13T20:57:23.314719001Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-running-upgrade-20210813205520-393438_3478da2c440ba32fb6c087b3f3b99813"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28","pid":2829,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28/rootfs","created":"2021-08-13T20:57:49.276286077Z","annotations":{"io.

kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f","pid":2608,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f/rootfs","created":"2021-08-13T20:57:24.457425933Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c","pid":2459,"status":"running","bundle":"/run

/containerd/io.containerd.runtime.v1.linux/k8s.io/6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c/rootfs","created":"2021-08-13T20:57:23.304768241Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-running-upgrade-20210813205520-393438_4baedbe3c5adfb275c862d08647c9d7c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386","pid":2437,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386/rootfs","created":"2

021-08-13T20:57:23.157193317Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-running-upgrade-20210813205520-393438_2c66c49fc02b209e1c6ab751769e1740"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054","pid":2457,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054/rootfs","created":"2021-08-13T20:57:23.308864324Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-syst

em_kube-controller-manager-running-upgrade-20210813205520-393438_f8d3d61ad8d45c80ab92bcedbe7fdb7d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c","pid":2976,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c/rootfs","created":"2021-08-13T20:57:51.894915758Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-74ff55c5b-ttqx2_5fa519a7-e077-42ec-8813-20a70746db5d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30","pid":3098,"status":"running","bundle":"/run/containerd/io.contain

erd.runtime.v1.linux/k8s.io/c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30/rootfs","created":"2021-08-13T20:57:54.598753561Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28","pid":3006,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28/rootfs","created":"2021-08-13T20:57:52.415569965Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri

.container-type":"container","io.kubernetes.cri.sandbox-id":"a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1","pid":2623,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1/rootfs","created":"2021-08-13T20:57:24.559344296Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c"},"owner":"root"}]

	I0813 20:58:47.869464  429197 cri.go:113] list returned 14 containers

	I0813 20:58:47.869484  429197 cri.go:116] container: {ID:0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f Status:running}

	I0813 20:58:47.869499  429197 cri.go:118] skipping 0e1462e69f29b3639ec31e5f2b822a9f5930b8289100d566fa75667da158dc0f - not in ps

	I0813 20:58:47.869509  429197 cri.go:116] container: {ID:0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b Status:running}

	I0813 20:58:47.869516  429197 cri.go:118] skipping 0e8921c6fa47913c43dd39c47d848e7a6dd968b52f53d46fe799da29fd86f47b - not in ps

	I0813 20:58:47.869525  429197 cri.go:116] container: {ID:0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27 Status:running}

	I0813 20:58:47.869533  429197 cri.go:122] skipping {0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27 running}: state = "running", want "paused"

	I0813 20:58:47.869553  429197 cri.go:116] container: {ID:1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb Status:running}

	I0813 20:58:47.869560  429197 cri.go:122] skipping {1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb running}: state = "running", want "paused"

	I0813 20:58:47.869567  429197 cri.go:116] container: {ID:38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b Status:running}

	I0813 20:58:47.869573  429197 cri.go:118] skipping 38160f60d9956f4a390631057fcedc5d21aeeb402f067fa5c96ba6a1b9b94e6b - not in ps

	I0813 20:58:47.869579  429197 cri.go:116] container: {ID:3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28 Status:running}

	I0813 20:58:47.869586  429197 cri.go:122] skipping {3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28 running}: state = "running", want "paused"

	I0813 20:58:47.869595  429197 cri.go:116] container: {ID:3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f Status:running}

	I0813 20:58:47.869603  429197 cri.go:122] skipping {3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f running}: state = "running", want "paused"

	I0813 20:58:47.869614  429197 cri.go:116] container: {ID:6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c Status:running}

	I0813 20:58:47.869621  429197 cri.go:118] skipping 6870ee5b4239d614db6ee600b7fe7b664c71ae99f2f850c62cc48b0efbf3e85c - not in ps

	I0813 20:58:47.869630  429197 cri.go:116] container: {ID:89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386 Status:running}

	I0813 20:58:47.869637  429197 cri.go:118] skipping 89a93112d35ab17ccb348fe762f756a1a804c0c7a83f28eb68540ae1eb078386 - not in ps

	I0813 20:58:47.869644  429197 cri.go:116] container: {ID:89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054 Status:running}

	I0813 20:58:47.869651  429197 cri.go:118] skipping 89f1f2c0c6f36d7b3f1d6b81b05c103f4928c211cd289aa414b5ab8150353054 - not in ps

	I0813 20:58:47.869657  429197 cri.go:116] container: {ID:a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c Status:running}

	I0813 20:58:47.869672  429197 cri.go:118] skipping a271f10af45a8439126cd8be1b83d4d5dbdb50e19b186bfd526b13f18277cc3c - not in ps

	I0813 20:58:47.869680  429197 cri.go:116] container: {ID:c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30 Status:running}

	I0813 20:58:47.869687  429197 cri.go:122] skipping {c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30 running}: state = "running", want "paused"

	I0813 20:58:47.869695  429197 cri.go:116] container: {ID:e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28 Status:running}

	I0813 20:58:47.869701  429197 cri.go:122] skipping {e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28 running}: state = "running", want "paused"

	I0813 20:58:47.869708  429197 cri.go:116] container: {ID:ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1 Status:running}

	I0813 20:58:47.869715  429197 cri.go:122] skipping {ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1 running}: state = "running", want "paused"

	I0813 20:58:47.869771  429197 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:58:47.879668  429197 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 20:58:47.879705  429197 kubeadm.go:600] restartCluster start

	I0813 20:58:47.879757  429197 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 20:58:47.888606  429197 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 20:58:47.889750  429197 kubeconfig.go:117] verify returned: extract IP: "running-upgrade-20210813205520-393438" does not appear in /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:58:47.890252  429197 kubeconfig.go:128] "running-upgrade-20210813205520-393438" context is missing from /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig - will repair!

	I0813 20:58:47.891314  429197 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:58:47.892631  429197 kapi.go:59] client config for running-upgrade-20210813205520-393438: &rest.Config{Host:"https://192.168.72.177:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles

/running-upgrade-20210813205520-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:58:47.895096  429197 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 20:58:47.903883  429197 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml

	+++ /var/tmp/minikube/kubeadm.yaml.new

	@@ -65,4 +65,10 @@

	 apiVersion: kubeproxy.config.k8s.io/v1alpha1

	 kind: KubeProxyConfiguration

	 clusterCIDR: "10.244.0.0/16"

	-metricsBindAddress: 192.168.72.177:10249

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I0813 20:58:47.903911  429197 kubeadm.go:1032] stopping kube-system containers ...

	I0813 20:58:47.903927  429197 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}

	I0813 20:58:47.903973  429197 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:58:47.931446  429197 cri.go:76] found id: "c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30"

	I0813 20:58:47.931466  429197 cri.go:76] found id: "e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28"

	I0813 20:58:47.931475  429197 cri.go:76] found id: "3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28"

	I0813 20:58:47.931484  429197 cri.go:76] found id: "ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1"

	I0813 20:58:47.931489  429197 cri.go:76] found id: "3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f"

	I0813 20:58:47.931494  429197 cri.go:76] found id: "1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb"

	I0813 20:58:47.931507  429197 cri.go:76] found id: "0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27"

	I0813 20:58:47.931514  429197 cri.go:76] found id: ""

	I0813 20:58:47.931522  429197 cri.go:221] Stopping containers: [c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30 e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28 3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28 ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1 3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f 1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb 0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27]

	I0813 20:58:47.931569  429197 ssh_runner.go:149] Run: which crictl

	I0813 20:58:47.958714  429197 ssh_runner.go:149] Run: sudo /bin/crictl stop c43ab17b0774aa10c9d1fbb1dabb095409e9b3a29f56184ee03392a8cf466a30 e17e08642ccf3029455c05f9ef2d581f6b84ad45d09b4c75a52093648d49be28 3affbef61aea25f1234c1c861ef47b68217e5d89707a851f56ebe78aa142ca28 ff4beae820c4c70b8321364f2c71658defd266b1c4c7160a5cb29f2e4af7a0d1 3f2845c78fc70aa002ff28cda11b386b7d144b2d7bcb8d5a58972d5e50f5255f 1d53355ae91096bb45667d179bb9f9c4ac70ddb1f821dfa7689260d62e6c5eeb 0f31470cf99d28981b50b7be4e4f2798bbfd4eae25eadc0a92f709971a55af27

	I0813 20:58:48.061021  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:48.061501  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:48.061531  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:48.061451  429868 retry.go:31] will retry after 3.36678925s: waiting for machine to come up

	I0813 20:58:51.431654  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:51.432173  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | unable to find current IP address of domain force-systemd-env-20210813205836-393438 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:58:51.432212  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | I0813 20:58:51.432125  429868 retry.go:31] will retry after 3.11822781s: waiting for machine to come up

	I0813 20:58:50.354953  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:50.354991  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:50.355010  429159 retry.go:31] will retry after 1.341783893s: only 1 pod(s) have shown up

	I0813 20:58:51.702107  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:51.702145  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:51.702160  429159 retry.go:31] will retry after 1.876813009s: only 1 pod(s) have shown up

	I0813 20:58:53.585061  429159 system_pods.go:59] 1 kube-system pods found

	I0813 20:58:53.585098  429159 system_pods.go:61] "storage-provisioner" [405d8164-fc79-11eb-952b-52540050ef93] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0813 20:58:53.585115  429159 retry.go:31] will retry after 2.6934314s: only 1 pod(s) have shown up

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	33fae69af6bcf       6e38f40d628db       30 seconds ago       Exited              storage-provisioner       0                   76aee79f917be

	b6372d9d76486       296a6d5035e2d       44 seconds ago       Running             coredns                   1                   cfc4c8785e479

	afabb5f130410       0369cf4303ffd       45 seconds ago       Running             etcd                      1                   3f41ec729ef71

	57f3f32f280d8       bc2bb319a7038       45 seconds ago       Running             kube-controller-manager   1                   ce1823a3db17a

	1053b5b4ba3ab       3d174f00aa39e       46 seconds ago       Running             kube-apiserver            1                   a655f217cf1c5

	0d1a942c8b8c2       adb2816ea823a       46 seconds ago       Running             kube-proxy                1                   47e050012dbca

	1d84b053549cf       6be0dc1302e30       46 seconds ago       Running             kube-scheduler            1                   53f314c6cf963

	1bba0d6deb033       adb2816ea823a       About a minute ago   Exited              kube-proxy                0                   3f6f239c2851f

	63c0cc1fc4c0c       296a6d5035e2d       About a minute ago   Exited              coredns                   0                   b1f1f31f28005

	698bbea7ce6e9       6be0dc1302e30       2 minutes ago        Exited              kube-scheduler            0                   5a66336a35add

	df02c38abac90       0369cf4303ffd       2 minutes ago        Exited              etcd                      0                   4cf745987f602

	68bad43283064       bc2bb319a7038       2 minutes ago        Exited              kube-controller-manager   0                   5340b4aa5ca39

	11c2753c9a8a7       3d174f00aa39e       2 minutes ago        Exited              kube-apiserver            0                   304b611d719ea

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:58:56 UTC. --

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.078142311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:etcd-pause-20210813205520-393438,Uid:86a000e5c08d32d80b2fd4e89cd34dd1,Namespace:kube-system,Attempt:1,} returns sandbox id \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.145266794Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for container &ContainerMetadata{Name:etcd,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.321521915Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\" returns successfully"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.349622186Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for &ContainerMetadata{Name:etcd,Attempt:1,} returns container id \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.353268082Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.376810925Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-558bd4d5db-jzmnb,Uid:ea00ae4c-f4d9-414c-8762-6314a96c8a06,Namespace:kube-system,Attempt:1,} returns sandbox id \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.451595226Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for container &ContainerMetadata{Name:coredns,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.633919582Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for &ContainerMetadata{Name:coredns,Attempt:1,} returns container id \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.635324605Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.770314446Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.016041628Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.229109322Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\" returns successfully"

	Aug 13 20:58:15 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:15.472167045Z" level=info msg="StartContainer for \"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5\" returns successfully"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.856093567Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,}"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.901091488Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a pid=4886

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.481756294Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,} returns sandbox id \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.492027606Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.607213854Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.614295374Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.876068804Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\" returns successfully"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.156236073Z" level=info msg="Finish piping stderr of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.158102368Z" level=info msg="Finish piping stdout of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.159567062Z" level=info msg="TaskExit event &TaskExit{ContainerID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,Pid:4945,ExitStatus:255,ExitedAt:2021-08-13 20:58:41.157732657 +0000 UTC,XXX_unrecognized:[],}"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217770540Z" level=info msg="shim disconnected" id=33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217941244Z" level=error msg="copy shim log" error="read /proc/self/fd/98: file already closed"

	* 

	* ==> coredns [63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I0813 20:57:49.980199       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.978) (total time: 30001ms):

	Trace[2019727887]: [30.001847928s] [30.001847928s] END

	E0813 20:57:49.980279       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.980655       1 trace.go:205] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[939984059]: [30.00501838s] [30.00501838s] END

	E0813 20:57:49.980691       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.981307       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[911902081]: [30.005916603s] [30.005916603s] END

	E0813 20:57:49.981521       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d] <==

	* E0813 20:58:20.310855       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:coredns" cannot list resource "services" in API group "" at the cluster scope

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	*                 "trace_clock=local"

	              on the kernel command line

	[  +0.000017] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.863604] systemd-fstab-generator[1160]: Ignoring "noauto" for root device

	[  +0.032050] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +0.917916] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=1722 comm=systemd-network

	[  +2.669268] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.

	[  +0.335717] vboxguest: loading out-of-tree module taints kernel.

	[  +0.008488] vboxguest: PCI device not found, probably running on physical hardware.

	[Aug13 20:56] systemd-fstab-generator[2101]: Ignoring "noauto" for root device

	[  +0.927578] systemd-fstab-generator[2132]: Ignoring "noauto" for root device

	[  +0.140064] systemd-fstab-generator[2146]: Ignoring "noauto" for root device

	[  +0.195734] systemd-fstab-generator[2179]: Ignoring "noauto" for root device

	[  +8.321149] systemd-fstab-generator[2386]: Ignoring "noauto" for root device

	[Aug13 20:57] systemd-fstab-generator[2823]: Ignoring "noauto" for root device

	[ +16.072552] kauditd_printk_skb: 38 callbacks suppressed

	[ +34.372009] kauditd_printk_skb: 116 callbacks suppressed

	[  +3.958113] NFSD: Unable to end grace period: -110

	[Aug13 20:58] systemd-fstab-generator[3706]: Ignoring "noauto" for root device

	[  +0.206181] systemd-fstab-generator[3719]: Ignoring "noauto" for root device

	[  +0.261980] systemd-fstab-generator[3744]: Ignoring "noauto" for root device

	[ +19.584639] kauditd_printk_skb: 41 callbacks suppressed

	[  +5.482860] systemd-fstab-generator[4981]: Ignoring "noauto" for root device

	[  +0.846439] systemd-fstab-generator[5035]: Ignoring "noauto" for root device

	* 

	* ==> etcd [afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5] <==

	* 2021-08-13 20:58:16.461857 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true " with result "range_response_count:0 size:5" took too long (198.960862ms) to execute

	2021-08-13 20:58:16.462013 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 " with result "range_response_count:0 size:5" took too long (199.025411ms) to execute

	2021-08-13 20:58:16.462116 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (190.42222ms) to execute

	2021-08-13 20:58:16.462337 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (179.184455ms) to execute

	2021-08-13 20:58:16.462702 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (172.711746ms) to execute

	2021-08-13 20:58:16.462925 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (170.528555ms) to execute

	2021-08-13 20:58:16.463221 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (158.293847ms) to execute

	2021-08-13 20:58:16.463747 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (158.490371ms) to execute

	2021-08-13 20:58:16.464124 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (152.464331ms) to execute

	2021-08-13 20:58:16.477058 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (151.343452ms) to execute

	2021-08-13 20:58:16.478005 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" count_only:true " with result "range_response_count:0 size:5" took too long (142.028022ms) to execute

	2021-08-13 20:58:16.478939 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" limit:10000 " with result "range_response_count:0 size:5" took too long (142.259692ms) to execute

	2021-08-13 20:58:16.479721 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (129.328346ms) to execute

	2021-08-13 20:58:16.479967 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (126.882803ms) to execute

	2021-08-13 20:58:16.480303 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:10000 " with result "range_response_count:11 size:5977" took too long (116.866258ms) to execute

	2021-08-13 20:58:16.480852 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true " with result "range_response_count:0 size:7" took too long (116.970061ms) to execute

	2021-08-13 20:58:23.354247 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/cluster-admin\" " with result "range_response_count:1 size:718" took too long (1.914180768s) to execute

	2021-08-13 20:58:23.356685 W | etcdserver: request "header:<ID:14244176716868856811 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" value_size:717 lease:5020804680014080881 >> failure:<>>" with result "size:16" took too long (1.23562281s) to execute

	2021-08-13 20:58:23.370142 W | wal: sync duration of 1.250273887s, expected less than 1s

	2021-08-13 20:58:23.370676 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.152835664s) to execute

	2021-08-13 20:58:23.371565 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.728436243s) to execute

	2021-08-13 20:58:23.371769 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.847351028s) to execute

	2021-08-13 20:58:23.378962 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-558bd4d5db-jzmnb\" " with result "range_response_count:1 size:4862" took too long (671.753147ms) to execute

	2021-08-13 20:58:24.705568 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:1 size:4394" took too long (221.501911ms) to execute

	2021-08-13 20:58:26.341296 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418] <==

	* 2021-08-13 20:56:51.867973 I | embed: serving client requests on 192.168.61.151:2379

	2021-08-13 20:56:51.875825 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:57:01.271062 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpointslicemirroring-controller\" " with result "range_response_count:0 size:5" took too long (480.2351ms) to execute

	2021-08-13 20:57:01.272131 W | etcdserver: read-only range request "key:\"/registry/minions/pause-20210813205520-393438\" " with result "range_response_count:1 size:3758" took too long (875.676682ms) to execute

	2021-08-13 20:57:01.273551 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f12dc\" " with result "range_response_count:1 size:735" took too long (792.283833ms) to execute

	2021-08-13 20:57:02.171621 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (872.818648ms) to execute

	2021-08-13 20:57:02.172160 W | etcdserver: request "header:<ID:14244176716848216677 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:222 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3993 >> failure:<request_range:<key:\"/registry/minions/pause-20210813205520-393438\" > >>" with result "size:16" took too long (128.660032ms) to execute

	2021-08-13 20:57:02.172330 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:351" took too long (871.615956ms) to execute

	2021-08-13 20:57:02.172733 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f2f58\" " with result "range_response_count:1 size:733" took too long (859.92991ms) to execute

	2021-08-13 20:57:02.172849 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (853.236151ms) to execute

	2021-08-13 20:57:09.290631 W | etcdserver: request "header:<ID:14244176716848216792 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:0 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3277 >> failure:<>>" with result "size:5" took too long (472.704737ms) to execute

	2021-08-13 20:57:09.291659 W | etcdserver: read-only range request "key:\"/registry/leases/kube-node-lease/pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (897.879132ms) to execute

	2021-08-13 20:57:09.298807 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-pause-20210813205520-393438\" " with result "range_response_count:1 size:4986" took too long (528.421007ms) to execute

	2021-08-13 20:57:09.299124 W | etcdserver: read-only range request "key:\"/registry/csinodes/pause-20210813205520-393438\" " with result "range_response_count:1 size:656" took too long (894.254864ms) to execute

	2021-08-13 20:57:13.314052 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" " with result "range_response_count:1 size:210" took too long (127.466898ms) to execute

	2021-08-13 20:57:13.314663 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (132.387511ms) to execute

	2021-08-13 20:57:16.343764 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:20.988739 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:30.989151 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:39.442816 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:422" took too long (120.094417ms) to execute

	2021-08-13 20:57:40.988900 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:50.989064 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:58:00.244154 W | etcdserver: request "header:<ID:14244176716848217456 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.61.151\" mod_revision:483 > success:<request_put:<key:\"/registry/masterleases/192.168.61.151\" value_size:69 lease:5020804679993441646 >> failure:<request_range:<key:\"/registry/masterleases/192.168.61.151\" > >>" with result "size:16" took too long (162.220853ms) to execute

	2021-08-13 20:58:00.245134 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (881.389444ms) to execute

	2021-08-13 20:58:00.989778 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:59:06 up 3 min,  0 users,  load average: 1.26, 0.86, 0.35

	Linux pause-20210813205520-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c] <==

	* I0813 20:58:20.351321       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 20:58:20.372737       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 20:58:20.375890       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 20:58:20.387225       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 20:58:20.401103       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:58:20.403283       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 20:58:20.407207       1 cache.go:39] Caches are synced for autoregister controller

	I0813 20:58:20.410957       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 20:58:21.065658       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 20:58:21.066635       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 20:58:21.090819       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 20:58:23.358425       1 trace.go:205] Trace[1442514083]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.628) (total time: 1729ms):

	Trace[1442514083]: ---"Object stored in database" 1729ms (20:58:00.358)

	Trace[1442514083]: [1.729557914s] [1.729557914s] END

	I0813 20:58:23.359893       1 trace.go:205] Trace[553017594]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/cluster-admin,user-agent:kube-apiserver/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (13-Aug-2021 20:58:21.438) (total time: 1920ms):

	Trace[553017594]: ---"About to write a response" 1919ms (20:58:00.358)

	Trace[553017594]: [1.920866407s] [1.920866407s] END

	I0813 20:58:23.381663       1 trace.go:205] Trace[1143050190]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-jzmnb,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:22.699) (total time: 682ms):

	Trace[1143050190]: ---"About to write a response" 681ms (20:58:00.380)

	Trace[1143050190]: [682.310081ms] [682.310081ms] END

	I0813 20:58:25.230359       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 20:58:25.281700       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 20:58:25.373725       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0813 20:58:25.413105       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:58:25.560667       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io

	* 

	* ==> kube-apiserver [11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016] <==

	* I0813 20:57:09.309542       1 trace.go:205] Trace[2046907584]: "Create" url:/api/v1/nodes,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.501) (total time: 806ms):

	Trace[2046907584]: [806.482297ms] [806.482297ms] END

	I0813 20:57:09.310802       1 trace.go:205] Trace[146959614]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.771) (total time: 538ms):

	Trace[146959614]: ---"Object stored in database" 538ms (20:57:00.310)

	Trace[146959614]: [538.954794ms] [538.954794ms] END

	I0813 20:57:09.311138       1 trace.go:205] Trace[1128950750]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-pause-20210813205520-393438,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1128950750]: ---"About to write a response" 537ms (20:57:00.307)

	Trace[1128950750]: [541.267103ms] [541.267103ms] END

	I0813 20:57:09.311248       1 trace.go:205] Trace[1268223707]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1268223707]: ---"Object stored in database" 540ms (20:57:00.310)

	Trace[1268223707]: [541.971563ms] [541.971563ms] END

	I0813 20:57:09.311433       1 trace.go:205] Trace[1977445463]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.772) (total time: 538ms):

	Trace[1977445463]: ---"Object stored in database" 537ms (20:57:00.310)

	Trace[1977445463]: [538.348208ms] [538.348208ms] END

	I0813 20:57:09.321803       1 trace.go:205] Trace[494614999]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 552ms):

	Trace[494614999]: [552.453895ms] [552.453895ms] END

	I0813 20:57:09.345220       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:57:16.259955       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	I0813 20:57:16.380865       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0813 20:57:37.272234       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:57:37.272418       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:57:37.272507       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:58:00.246413       1 trace.go:205] Trace[1997979141]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (13-Aug-2021 20:57:59.258) (total time: 987ms):

	Trace[1997979141]: ---"Transaction committed" 984ms (20:58:00.246)

	Trace[1997979141]: [987.521712ms] [987.521712ms] END

	* 

	* ==> kube-controller-manager [57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849] <==

	* I0813 20:58:25.074041       1 daemon_controller.go:285] Starting daemon sets controller

	I0813 20:58:25.074050       1 shared_informer.go:240] Waiting for caches to sync for daemon sets

	I0813 20:58:25.116517       1 controllermanager.go:574] Started "horizontalpodautoscaling"

	I0813 20:58:25.116556       1 horizontal.go:169] Starting HPA controller

	I0813 20:58:25.116758       1 shared_informer.go:240] Waiting for caches to sync for HPA

	E0813 20:58:25.120839       1 core.go:91] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail

	W0813 20:58:25.120857       1 controllermanager.go:566] Skipping "service"

	I0813 20:58:25.124370       1 controllermanager.go:574] Started "persistentvolume-expander"

	I0813 20:58:25.124569       1 expand_controller.go:327] Starting expand controller

	I0813 20:58:25.124579       1 shared_informer.go:240] Waiting for caches to sync for expand

	I0813 20:58:25.175876       1 controllermanager.go:574] Started "namespace"

	I0813 20:58:25.176251       1 namespace_controller.go:200] Starting namespace controller

	I0813 20:58:25.176376       1 shared_informer.go:240] Waiting for caches to sync for namespace

	I0813 20:58:25.185657       1 controllermanager.go:574] Started "serviceaccount"

	I0813 20:58:25.187325       1 serviceaccounts_controller.go:117] Starting service account controller

	I0813 20:58:25.187340       1 shared_informer.go:240] Waiting for caches to sync for service account

	I0813 20:58:25.192151       1 controllermanager.go:574] Started "replicaset"

	I0813 20:58:25.192315       1 replica_set.go:182] Starting replicaset controller

	I0813 20:58:25.192327       1 shared_informer.go:240] Waiting for caches to sync for ReplicaSet

	I0813 20:58:25.200141       1 controllermanager.go:574] Started "bootstrapsigner"

	I0813 20:58:25.200611       1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer

	I0813 20:58:25.204061       1 controllermanager.go:574] Started "cronjob"

	I0813 20:58:25.204578       1 cronjob_controllerv2.go:125] Starting cronjob controller v2

	I0813 20:58:25.204590       1 shared_informer.go:240] Waiting for caches to sync for cronjob

	I0813 20:58:25.207401       1 node_ipam_controller.go:91] Sending events to api server.

	* 

	* ==> kube-controller-manager [68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8] <==

	* I0813 20:57:15.593972       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:57:15.593991       1 disruption.go:371] Sending events to api server.

	I0813 20:57:15.596695       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:57:15.636700       1 shared_informer.go:247] Caches are synced for service account 

	I0813 20:57:15.652896       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:57:15.701400       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:57:15.701628       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:57:15.701702       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:57:15.701748       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:57:15.701825       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:57:15.702024       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	I0813 20:57:15.735577       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0813 20:57:15.751667       1 shared_informer.go:247] Caches are synced for stateful set 

	I0813 20:57:15.767285       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:15.796364       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:57:15.847876       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:16.199991       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.200121       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:57:16.224599       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.277997       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:57:16.457337       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-mlf5c"

	I0813 20:57:16.545672       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-fhxw7"

	I0813 20:57:16.596799       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-jzmnb"

	I0813 20:57:16.804186       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:57:16.819742       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-fhxw7"

	* 

	* ==> kube-proxy [0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5] <==

	* E0813 20:58:20.334846       1 node.go:161] Failed to retrieve node info: nodes "pause-20210813205520-393438" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I0813 20:58:21.364522       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:58:21.365223       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:58:21.366125       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:58:23.461362       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:58:23.462248       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:58:23.465333       1 server_others.go:212] Using iptables Proxier.

	I0813 20:58:23.483125       1 server.go:643] Version: v1.21.3

	I0813 20:58:23.488959       1 config.go:315] Starting service config controller

	I0813 20:58:23.490323       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:58:23.490593       1 config.go:224] Starting endpoint slice config controller

	I0813 20:58:23.490606       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:58:23.512424       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:58:23.514744       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:58:23.591163       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:58:23.593313       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62] <==

	* I0813 20:57:20.123665       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:57:20.123841       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:57:20.123909       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:57:20.180054       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:57:20.180158       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:57:20.180173       1 server_others.go:212] Using iptables Proxier.

	I0813 20:57:20.181825       1 server.go:643] Version: v1.21.3

	I0813 20:57:20.184367       1 config.go:315] Starting service config controller

	I0813 20:57:20.184561       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:57:20.184600       1 config.go:224] Starting endpoint slice config controller

	I0813 20:57:20.184604       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:57:20.203222       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:57:20.207174       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:57:20.285130       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:57:20.285144       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c] <==

	* I0813 20:58:11.830530       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:58:20.220887       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:58:20.224373       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:58:20.224624       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:58:20.224640       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:58:20.341243       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:58:20.343223       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.343608       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.347257       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:58:20.444874       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	W0813 20:59:05.413646       1 reflector.go:436] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: watch of *v1.ConfigMap ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	* 

	* ==> kube-scheduler [698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889] <==

	* I0813 20:56:57.340096       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:56:57.373873       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:57.375600       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:57.398047       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:57.406392       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:56:57.418940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.424521       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:57.426539       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:56:57.426578       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:56:57.428616       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428765       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:56:57.428811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:57.428897       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:56:58.261670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:58.311937       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:58.405804       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.463800       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:58.585826       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.615525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:58.626736       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.669986       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:58.791820       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0813 20:57:01.440271       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:59:12 UTC. --

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.453957    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454194    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454410    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454727    2832 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"pause-20210813205520-393438\": Get \"https://control-plane.minikube.internal:8443/api/v1/nodes/pause-20210813205520-393438?timeout=10s\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.454757    2832 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Aug 13 20:58:09 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:09.611414    2832 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-pause-20210813205520-393438.169af943ec02b0a4", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-pause-20210813205520-393438", UID:"36ca0d21ef43020c8f018e62049ff15f", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"Unhealthy", Message:"Readines

s probe failed: Get \"https://192.168.61.151:8443/readyz\": dial tcp 192.168.61.151:8443: connect: connection refused", Source:v1.EventSource{Component:"kubelet", Host:"pause-20210813205520-393438"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc03dd51755ca4ea4, ext:62717519917, loc:(*time.Location)(0x74c3600)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/events": dial tcp 192.168.61.151:8443: connect: connection refused'(may retry after sleeping)

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.428873    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429203    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.429890    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430165    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430396    2832 controller.go:187] failed to update lease, error: Put "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:10.430620    2832 controller.go:114] failed to update lease using latest lease, fallback to ensure lease, err: failed 5 attempts to update lease

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.430883    2832 controller.go:144] failed to ensure lease exists, will retry in 200ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:10 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:10.632976    2832 controller.go:144] failed to ensure lease exists, will retry in 400ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:11.038724    2832 controller.go:144] failed to ensure lease exists, will retry in 800ms, error: Get "https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20210813205520-393438?timeout=10s": dial tcp 192.168.61.151:8443: connect: connection refused

	Aug 13 20:58:11 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:11.294567    2832 status_manager.go:566] "Failed to get status for pod" podUID=469cea0375ae276925a50e4dde7e4ace pod="kube-system/kube-scheduler-pause-20210813205520-393438" error="Get \"https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-pause-20210813205520-393438\": dial tcp 192.168.61.151:8443: connect: connection refused"

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.266431    2832 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:20 pause-20210813205520-393438 kubelet[2832]: E0813 20:58:20.269986    2832 reflector.go:138] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.541317    2832 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590904    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6vd\" (UniqueName: \"kubernetes.io/projected/99920d7c-bb8d-4c65-bf44-b56f23a40e53-kube-api-access-xw6vd\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:25 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:25.590979    2832 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/99920d7c-bb8d-4c65-bf44-b56f23a40e53-tmp\") pod \"storage-provisioner\" (UID: \"99920d7c-bb8d-4c65-bf44-b56f23a40e53\") "

	Aug 13 20:58:29 pause-20210813205520-393438 kubelet[2832]: I0813 20:58:29.362225    2832 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: kubelet.service: Succeeded.

	Aug 13 20:58:29 pause-20210813205520-393438 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81] <==

	* 	/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:880 +0x4af

	goroutine 90 [sync.Cond.Wait]:

	sync.runtime_notifyListWait(0xc000328290, 0xc000000003)

		/usr/local/go/src/runtime/sema.go:513 +0xf8

	sync.(*Cond).Wait(0xc000328280)

		/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0003f0480, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003bcc80, 0x18e5530, 0xc0003284c0, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004ceee0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0004ceee0, 0x18b3d60, 0xc000311f80, 0x1, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004ceee0, 0x3b9aca00, 0x0, 0x17a0501, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc0004ceee0, 0x3b9aca00, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

-- /stdout --

** stderr ** 

	E0813 20:59:06.860332  430249 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:250: failed logs error: exit status 110

--- FAIL: TestPause/serial/VerifyStatus (19.09s)

=== RUN   TestPause/serial/PauseAgain

pause_test.go:107: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5

pause_test.go:107: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5: exit status 80 (6.028472955s)

-- stdout --

	* Pausing node pause-20210813205520-393438 ... 

-- /stdout --

** stderr ** 

	I0813 20:59:15.921046  430471 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:59:15.921213  430471 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:15.921242  430471 out.go:311] Setting ErrFile to fd 2...

	I0813 20:59:15.921253  430471 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:15.921447  430471 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:59:15.921711  430471 out.go:305] Setting JSON to false

	I0813 20:59:15.921742  430471 mustload.go:65] Loading cluster: pause-20210813205520-393438

	I0813 20:59:15.922106  430471 config.go:177] Loaded profile config "pause-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.21.3

	I0813 20:59:15.922604  430471 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:15.922654  430471 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:15.939440  430471 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:41217

	I0813 20:59:15.939967  430471 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:15.940636  430471 main.go:130] libmachine: Using API Version  1

	I0813 20:59:15.940662  430471 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:15.941150  430471 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:15.941333  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetState

	I0813 20:59:15.945745  430471 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:59:15.946205  430471 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:15.946245  430471 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:15.962767  430471 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40319

	I0813 20:59:15.966767  430471 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:15.967390  430471 main.go:130] libmachine: Using API Version  1

	I0813 20:59:15.967412  430471 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:15.967878  430471 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:15.968070  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:59:15.968867  430471 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=

true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso https://github.com/kubernetes/minikube/releases/download/v1.22.0-1628622362-12032/minikube-v1.22.0-1628622362-12032.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.22.0-1628622362-12032.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu

gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20210813205520-393438 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I0813 20:59:15.972744  430471 out.go:177] * Pausing node pause-20210813205520-393438 ... 

	I0813 20:59:15.972777  430471 host.go:66] Checking if "pause-20210813205520-393438" exists ...

	I0813 20:59:15.973334  430471 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:15.973372  430471 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:15.990765  430471 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:35621

	I0813 20:59:15.993328  430471 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:15.994029  430471 main.go:130] libmachine: Using API Version  1

	I0813 20:59:15.994054  430471 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:15.994739  430471 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:15.994928  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .DriverName

	I0813 20:59:15.995152  430471 ssh_runner.go:149] Run: systemctl --version

	I0813 20:59:15.995204  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:59:16.004157  430471 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:59:16.004762  430471 main.go:130] libmachine: (pause-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:e2:3d", ip: ""} in network mk-pause-20210813205520-393438: {Iface:virbr3 ExpiryTime:2021-08-13 21:55:55 +0000 UTC Type:0 Mac:52:54:00:52:e2:3d Iaid: IPaddr:192.168.61.151 Prefix:24 Hostname:pause-20210813205520-393438 Clientid:01:52:54:00:52:e2:3d}

	I0813 20:59:16.004807  430471 main.go:130] libmachine: (pause-20210813205520-393438) DBG | domain pause-20210813205520-393438 has defined IP address 192.168.61.151 and MAC address 52:54:00:52:e2:3d in network mk-pause-20210813205520-393438

	I0813 20:59:16.005015  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHPort

	I0813 20:59:16.010766  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.010953  430471 main.go:130] libmachine: (pause-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:59:16.011226  430471 sshutil.go:53] new ssh client: &{IP:192.168.61.151 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/pause-20210813205520-393438/id_rsa Username:docker}

	I0813 20:59:16.158997  430471 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:59:16.171390  430471 pause.go:50] kubelet running: true

	I0813 20:59:16.171440  430471 ssh_runner.go:149] Run: sudo systemctl disable --now kubelet

	I0813 20:59:21.508823  430471 ssh_runner.go:189] Completed: sudo systemctl disable --now kubelet: (5.337357916s)

	I0813 20:59:21.508892  430471 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I0813 20:59:21.508960  430471 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I0813 20:59:21.733676  430471 cri.go:76] found id: "33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81"

	I0813 20:59:21.733708  430471 cri.go:76] found id: "b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d"

	I0813 20:59:21.733715  430471 cri.go:76] found id: "afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5"

	I0813 20:59:21.733721  430471 cri.go:76] found id: "57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849"

	I0813 20:59:21.733727  430471 cri.go:76] found id: "1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c"

	I0813 20:59:21.733732  430471 cri.go:76] found id: "0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5"

	I0813 20:59:21.733737  430471 cri.go:76] found id: "1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c"

	I0813 20:59:21.733743  430471 cri.go:76] found id: "1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62"

	I0813 20:59:21.733748  430471 cri.go:76] found id: "63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0"

	I0813 20:59:21.733757  430471 cri.go:76] found id: "698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889"

	I0813 20:59:21.733768  430471 cri.go:76] found id: "df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418"

	I0813 20:59:21.733776  430471 cri.go:76] found id: "68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8"

	I0813 20:59:21.733782  430471 cri.go:76] found id: "11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016"

	I0813 20:59:21.733787  430471 cri.go:76] found id: ""

	I0813 20:59:21.733852  430471 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I0813 20:59:21.791197  430471 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","pid":4658,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5/rootfs","created":"2021-08-13T20:58:12.412888441Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","pid":4590,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c","rootfs":"/run/containerd/io.containerd.runtime

.v2.task/k8s.io/1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c/rootfs","created":"2021-08-13T20:58:11.057580039Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","pid":4542,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c/rootfs","created":"2021-08-13T20:58:10.472076836Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872"},"owner":"root"

},{"ociVersion":"1.0.2-dev","id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","pid":4374,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf/rootfs","created":"2021-08-13T20:58:09.064644692Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20210813205520-393438_86a000e5c08d32d80b2fd4e89cd34dd1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","pid":4269,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","rootfs":"/run/con

tainerd/io.containerd.runtime.v2.task/k8s.io/47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94/rootfs","created":"2021-08-13T20:58:08.848304205Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-mlf5c_c0812228-e936-4bfa-9fbb-a4d0707f2a63"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","pid":4244,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872/rootfs","created":"2021-08-13T20:58:08.637074413Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"53f314c6cf963d0b7a2ce2addc78d39af197

7ebeeb0041cf9eb5208c13771872","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20210813205520-393438_469cea0375ae276925a50e4dde7e4ace"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","pid":4624,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849/rootfs","created":"2021-08-13T20:58:11.449040242Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","pid":4909,"status":"running","bundle":"/run/containerd/io.

containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a/rootfs","created":"2021-08-13T20:58:26.026296621Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_99920d7c-bb8d-4c65-bf44-b56f23a40e53"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","pid":4366,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22/rootfs","created":"2021-08-13T20:58:09.044079666Z","annota

tions":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20210813205520-393438_36ca0d21ef43020c8f018e62049ff15f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","pid":4682,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5/rootfs","created":"2021-08-13T20:58:11.953431943Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b6372d9d7648658f7077421

ada6d80fd2a27141edbbd6ee51d78346ef736205d","pid":4701,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d/rootfs","created":"2021-08-13T20:58:12.144003819Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","pid":4318,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1/rootfs","created":"2021-08-13T20:58:

08.900909328Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20210813205520-393438_81d9f8c777d9fb26ff8b7d9c93d26d5e"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","pid":4486,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682/rootfs","created":"2021-08-13T20:58:09.821697744Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_coredns-558bd4d5

db-jzmnb_ea00ae4c-f4d9-414c-8762-6314a96c8a06"},"owner":"root"}]

	I0813 20:59:21.791474  430471 cri.go:113] list returned 13 containers

	I0813 20:59:21.791489  430471 cri.go:116] container: {ID:0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 Status:running}

	I0813 20:59:21.791518  430471 cri.go:116] container: {ID:1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c Status:running}

	I0813 20:59:21.791525  430471 cri.go:116] container: {ID:1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c Status:running}

	I0813 20:59:21.791531  430471 cri.go:116] container: {ID:3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf Status:running}

	I0813 20:59:21.791538  430471 cri.go:118] skipping 3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf - not in ps

	I0813 20:59:21.791547  430471 cri.go:116] container: {ID:47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 Status:running}

	I0813 20:59:21.791554  430471 cri.go:118] skipping 47e050012dbca19a38705743976e702aa5815af3e39eaebbfe81753ef825ae94 - not in ps

	I0813 20:59:21.791572  430471 cri.go:116] container: {ID:53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 Status:running}

	I0813 20:59:21.791580  430471 cri.go:118] skipping 53f314c6cf963d0b7a2ce2addc78d39af1977ebeeb0041cf9eb5208c13771872 - not in ps

	I0813 20:59:21.791586  430471 cri.go:116] container: {ID:57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849 Status:running}

	I0813 20:59:21.791592  430471 cri.go:116] container: {ID:76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a Status:running}

	I0813 20:59:21.791598  430471 cri.go:118] skipping 76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a - not in ps

	I0813 20:59:21.791603  430471 cri.go:116] container: {ID:a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 Status:running}

	I0813 20:59:21.791610  430471 cri.go:118] skipping a655f217cf1c593801e3e12b8f146d58659a68597b4a75eb09c282cdb37a9f22 - not in ps

	I0813 20:59:21.791615  430471 cri.go:116] container: {ID:afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5 Status:running}

	I0813 20:59:21.791621  430471 cri.go:116] container: {ID:b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d Status:running}

	I0813 20:59:21.791626  430471 cri.go:116] container: {ID:ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 Status:running}

	I0813 20:59:21.791632  430471 cri.go:118] skipping ce1823a3db17ab7c022320520c4d6f3883120956070d204162dc421dc44b43c1 - not in ps

	I0813 20:59:21.791637  430471 cri.go:116] container: {ID:cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 Status:running}

	I0813 20:59:21.791643  430471 cri.go:118] skipping cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682 - not in ps

	I0813 20:59:21.791694  430471 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5

	I0813 20:59:21.820803  430471 ssh_runner.go:149] Run: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c

	I0813 20:59:21.858657  430471 out.go:177] 

	W0813 20:59:21.858832  430471 out.go:242] X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c: Process exited with status 1

	stdout:

	Incorrect Usage.

	NAME:

	   runc pause - pause suspends all processes inside the container

	USAGE:

	   runc pause <container-id>

	Where "<container-id>" is the name for the instance of the container to be

	paused. 

	DESCRIPTION:

	   The pause command suspends all processes in the instance of the container.

	Use runc list to identify instances of containers and their current status.

	stderr:

	time="2021-08-13T20:59:21Z" level=error msg="runc: \"pause\" requires exactly 1 argument(s)"

	X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause 0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5 1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c: Process exited with status 1

	stdout:

	Incorrect Usage.

	NAME:

	   runc pause - pause suspends all processes inside the container

	USAGE:

	   runc pause <container-id>

	Where "<container-id>" is the name for the instance of the container to be

	paused. 

	DESCRIPTION:

	   The pause command suspends all processes in the instance of the container.

	Use runc list to identify instances of containers and their current status.

	stderr:

	time="2021-08-13T20:59:21Z" level=error msg="runc: \"pause\" requires exactly 1 argument(s)"

	W0813 20:59:21.858876  430471 out.go:242] * 

	* 

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	[warning]: invalid value provided to Color, using default

	W0813 20:59:21.863623  430471 out.go:242] ╭──────────────────────────────────────────────────────────────────────────────╮

	│                                                                              │

	│    * If the above advice does not help, please let us know:                  │

	│      https://github.com/kubernetes/minikube/issues/new/choose                │

	│                                                                              │

	│    * Please attach the following file to the GitHub issue:                   │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                              │

	╰──────────────────────────────────────────────────────────────────────────────╯

	╭──────────────────────────────────────────────────────────────────────────────╮

	│                                                                              │

	│    * If the above advice does not help, please let us know:                  │

	│      https://github.com/kubernetes/minikube/issues/new/choose                │

	│                                                                              │

	│    * Please attach the following file to the GitHub issue:                   │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                              │

	╰──────────────────────────────────────────────────────────────────────────────╯

	I0813 20:59:21.865248  430471 out.go:177] 

** /stderr **

pause_test.go:109: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20210813205520-393438 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

E0813 20:59:22.129848  393438 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813202056-393438/client.crt: no such file or directory

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (349.240434ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25: (1.824357713s)

helpers_test.go:253: TestPause/serial/PauseAgain logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                   Args                   |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:40:58 UTC | Fri, 13 Aug 2021 20:40:59 UTC |

	|         | node delete m03                          |                                          |         |         |                               |                               |

	| -p      | multinode-20210813202658-393438          | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:41:00 UTC | Fri, 13 Aug 2021 20:44:04 UTC |

	|         | stop                                     |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:44:04 UTC | Fri, 13 Aug 2021 20:48:01 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr --driver=kvm2          |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:48:01 UTC | Fri, 13 Aug 2021 20:49:01 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:02 UTC | Fri, 13 Aug 2021 20:49:03 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:03 UTC | Fri, 13 Aug 2021 20:49:05 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:50:38 UTC | Fri, 13 Aug 2021 20:52:46 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | --wait=true --preload=false              |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:47 UTC | Fri, 13 Aug 2021 20:52:48 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl pull busybox              |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:48 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=kvm2           |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl image ls                  |                                          |         |         |                               |                               |

	| delete  | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:41 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	| start   | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:41 UTC | Fri, 13 Aug 2021 20:54:41 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --memory=2048 --driver=kvm2              |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:42 UTC | Fri, 13 Aug 2021 20:54:42 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --cancel-scheduled                       |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:55 UTC | Fri, 13 Aug 2021 20:55:02 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --schedule 5s                            |                                          |         |         |                               |                               |

	| delete  | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:20 UTC | Fri, 13 Aug 2021 20:55:20 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	| start   | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:33 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048     |                                          |         |         |                               |                               |

	|         | --wait=true --driver=kvm2                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:33 UTC | Fri, 13 Aug 2021 20:57:35 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:54 UTC |

	|         | --memory=2048                            |                                          |         |         |                               |                               |

	|         | --install-addons=false                   |                                          |         |         |                               |                               |

	|         | --wait=all --driver=kvm2                 |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:54 UTC | Fri, 13 Aug 2021 20:58:28 UTC |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:27 UTC | Fri, 13 Aug 2021 20:58:34 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| logs    | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:34 UTC | Fri, 13 Aug 2021 20:58:35 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| delete  | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:35 UTC | Fri, 13 Aug 2021 20:58:36 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| start   | -p                                       | kubernetes-upgrade-20210813205735-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:35 UTC | Fri, 13 Aug 2021 20:58:58 UTC |

	|         | kubernetes-upgrade-20210813205735-393438 |                                          |         |         |                               |                               |

	|         | --memory=2200                            |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.14.0             |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --driver=kvm2     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | kubernetes-upgrade-20210813205735-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:58 UTC | Fri, 13 Aug 2021 20:59:00 UTC |

	|         | kubernetes-upgrade-20210813205735-393438 |                                          |         |         |                               |                               |

	| unpause | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:59:14 UTC | Fri, 13 Aug 2021 20:59:15 UTC |

	|         | --alsologtostderr -v=5                   |                                          |         |         |                               |                               |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:59:01

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:59:01.126131  430322 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:59:01.126334  430322 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:01.126345  430322 out.go:311] Setting ErrFile to fd 2...

	I0813 20:59:01.126349  430322 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:01.126438  430322 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:59:01.126658  430322 out.go:305] Setting JSON to false

	I0813 20:59:01.168018  430322 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":6103,"bootTime":1628882238,"procs":194,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:59:01.168125  430322 start.go:121] virtualization: kvm guest

	I0813 20:59:01.170881  430322 out.go:177] * [kubernetes-upgrade-20210813205735-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:59:01.172410  430322 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:59:01.171037  430322 notify.go:169] Checking for updates...

	I0813 20:59:01.173939  430322 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:59:01.175272  430322 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:59:01.176563  430322 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:59:01.176998  430322 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:59:01.177535  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.177578  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.190824  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:42145

	I0813 20:59:01.191328  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.192096  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.192126  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.192607  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.192838  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.193041  430322 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:59:01.193517  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.193562  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.208017  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37221

	I0813 20:59:01.209032  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.209672  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.209701  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.210226  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.210435  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.248561  430322 out.go:177] * Using the kvm2 driver based on existing profile

	I0813 20:59:01.248588  430322 start.go:278] selected driver: kvm2

	I0813 20:59:01.248595  430322 start.go:751] validating driver "kvm2" against &{Name:kubernetes-upgrade-20210813205735-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20210813205735-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:01.248717  430322 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:59:01.250011  430322 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:59:01.250160  430322 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:59:01.262799  430322 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:59:01.263220  430322 cni.go:93] Creating CNI manager for ""

	I0813 20:59:01.263239  430322 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:59:01.263251  430322 start_flags.go:277] config:

	{Name:kubernetes-upgrade-20210813205735-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.0-rc.0 ClusterName:kubernetes-upgrade-2021081320573

5-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:01.263415  430322 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:59:01.265573  430322 out.go:177] * Starting control plane node kubernetes-upgrade-20210813205735-393438 in cluster kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.265601  430322 preload.go:131] Checking if preload exists for k8s version v1.22.0-rc.0 and runtime containerd

	I0813 20:59:01.265646  430322 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4

	I0813 20:59:01.265665  430322 cache.go:56] Caching tarball of preloaded images

	I0813 20:59:01.265770  430322 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:59:01.265790  430322 cache.go:59] Finished verifying existence of preloaded tar for  v1.22.0-rc.0 on containerd

	I0813 20:59:01.265928  430322 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/config.json ...

	I0813 20:59:01.266108  430322 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:59:01.266142  430322 start.go:313] acquiring machines lock for kubernetes-upgrade-20210813205735-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:59:01.266204  430322 start.go:317] acquired machines lock for "kubernetes-upgrade-20210813205735-393438" in 45.243µs

	I0813 20:59:01.266222  430322 start.go:93] Skipping create...Using existing machine configuration

	I0813 20:59:01.266233  430322 fix.go:55] fixHost starting: 

	I0813 20:59:01.266656  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.266753  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.279307  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:45157

	I0813 20:59:01.279807  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.280359  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.280380  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.280834  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.281039  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.281186  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:59:01.284783  430322 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20210813205735-393438: state=Stopped err=<nil>

	I0813 20:59:01.284823  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	W0813 20:59:01.284949  430322 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 20:58:59.870373  429844 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.008983457s)

	I0813 20:58:59.871116  429844 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.21.3". assuming images are not preloaded.

	I0813 20:58:59.871287  429844 ssh_runner.go:149] Run: which lz4

	I0813 20:58:59.880284  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0813 20:58:59.880368  429844 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:58:59.885231  429844 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:58:59.885260  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (928970367 bytes)

	I0813 20:59:00.541957  429197 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0813 20:59:00.550528  429197 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 20:59:00.550578  429197 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 20:59:00.558098  429197 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0813 20:59:00.564879  429197 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 20:59:00.564943  429197 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 20:59:00.573424  429197 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:00.581588  429197 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:00.581608  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:00.775307  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.073222  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.297863235s)

	I0813 20:59:02.073255  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.470011  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.646948  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.826557  429197 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:59:02.826636  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:03.341139  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:03.840915  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:04.340501  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:04.841157  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:05.341002  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:01.287021  430322 out.go:177] * Restarting existing kvm2 VM for "kubernetes-upgrade-20210813205735-393438" ...

	I0813 20:59:01.287050  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Start

	I0813 20:59:01.287193  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring networks are active...

	I0813 20:59:01.289470  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring network default is active

	I0813 20:59:01.289937  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring network mk-kubernetes-upgrade-20210813205735-393438 is active

	I0813 20:59:01.290387  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Getting domain xml...

	I0813 20:59:01.292866  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Creating domain...

	I0813 20:59:01.738864  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Waiting to get IP...

	I0813 20:59:01.739927  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.740403  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has current primary IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.740436  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Found IP for machine: 192.168.39.75

	I0813 20:59:01.740459  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserving static IP address...

	I0813 20:59:01.741000  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "kubernetes-upgrade-20210813205735-393438", mac: "52:54:00:50:ef:93", ip: "192.168.39.75"} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:01.741035  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | skip adding static IP to network mk-kubernetes-upgrade-20210813205735-393438 - found existing host DHCP lease matching {name: "kubernetes-upgrade-20210813205735-393438", mac: "52:54:00:50:ef:93", ip: "192.168.39.75"}

	I0813 20:59:01.741051  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserved static IP address: 192.168.39.75

	I0813 20:59:01.741072  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Waiting for SSH to be available...

	I0813 20:59:01.741092  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Getting to WaitForSSH function...

	I0813 20:59:01.747891  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.748311  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:01.748341  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.748794  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH client type: external

	I0813 20:59:01.748825  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH private key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa (-rw-------)

	I0813 20:59:01.748867  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.75 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0813 20:59:01.748881  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | About to run SSH command:

	I0813 20:59:01.748893  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | exit 0

	I0813 20:59:04.251439  429844 containerd.go:546] Took 4.371086 seconds to copy over tarball

	I0813 20:59:04.251530  429844 ssh_runner.go:149] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0813 20:59:05.840828  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:06.340641  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:06.840589  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:07.340738  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:07.840607  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:08.340740  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:08.841423  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:09.341300  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:09.840616  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:10.340878  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:10.840590  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:11.340551  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:11.840776  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:12.341416  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:12.841143  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:13.340641  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:13.840699  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:14.340891  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:14.841272  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:15.340868  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:15.367894  429197 api_server.go:70] duration metric: took 12.541339791s to wait for apiserver process to appear ...

	I0813 20:59:15.367920  429197 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:59:15.367932  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:15.369463  429197 api_server.go:255] stopped: https://192.168.72.177:8443/healthz: Get "https://192.168.72.177:8443/healthz": dial tcp 192.168.72.177:8443: connect: connection refused

	I0813 20:59:14.967460  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | SSH cmd err, output: <nil>: 

	I0813 20:59:14.967832  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetConfigRaw

	I0813 20:59:14.968579  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:14.975946  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.976590  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:14.976617  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.977080  430322 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/config.json ...

	I0813 20:59:14.977327  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:14.977519  430322 machine.go:88] provisioning docker machine ...

	I0813 20:59:14.977551  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:14.977744  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:14.977932  430322 buildroot.go:166] provisioning hostname "kubernetes-upgrade-20210813205735-393438"

	I0813 20:59:14.977959  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:14.978140  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:14.984614  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.984978  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:14.985004  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.985249  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:14.985456  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:14.985630  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:14.985808  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:14.986008  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:14.986206  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:14.986228  430322 main.go:130] libmachine: About to run SSH command:

	sudo hostname kubernetes-upgrade-20210813205735-393438 && echo "kubernetes-upgrade-20210813205735-393438" | sudo tee /etc/hostname

	I0813 20:59:15.154609  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.154644  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.161683  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.162112  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.162145  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.162482  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:15.162710  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.162936  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.163108  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:15.163323  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:15.163532  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:15.163559  430322 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\skubernetes-upgrade-20210813205735-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20210813205735-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 kubernetes-upgrade-20210813205735-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:59:15.322283  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:59:15.322316  430322 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:59:15.322360  430322 buildroot.go:174] setting up certificates

	I0813 20:59:15.322375  430322 provision.go:83] configureAuth start

	I0813 20:59:15.322388  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:15.322753  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:15.329092  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.329518  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.329541  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.330028  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.335895  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.336319  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.336343  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.336720  430322 provision.go:138] copyHostCerts

	I0813 20:59:15.336809  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 20:59:15.336821  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 20:59:15.336872  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:59:15.336988  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 20:59:15.336997  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 20:59:15.337026  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:59:15.337088  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 20:59:15.337150  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 20:59:15.337183  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:59:15.337294  430322 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-20210813205735-393438 san=[192.168.39.75 192.168.39.75 localhost 127.0.0.1 minikube kubernetes-upgrade-20210813205735-393438]

	I0813 20:59:15.804742  430322 provision.go:172] copyRemoteCerts

	I0813 20:59:15.804803  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:59:15.804839  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.810630  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.811009  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.811045  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.811311  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:15.811513  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.811677  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:15.811829  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:15.907977  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:59:15.926182  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1289 bytes)

	I0813 20:59:15.969182  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 20:59:15.994398  430322 provision.go:86] duration metric: configureAuth took 672.012293ms

	I0813 20:59:15.994426  430322 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:59:15.994619  430322 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.22.0-rc.0

	I0813 20:59:15.994636  430322 machine.go:91] provisioned docker machine in 1.017093923s

	I0813 20:59:15.994647  430322 start.go:267] post-start starting for "kubernetes-upgrade-20210813205735-393438" (driver="kvm2")

	I0813 20:59:15.994656  430322 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:59:15.994706  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:15.998921  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:59:15.998955  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.005687  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.006139  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.006166  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.006764  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.006965  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.007139  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.007310  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:14.775039  429844 ssh_runner.go:189] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (10.523480791s)

	I0813 20:59:14.775063  429844 containerd.go:553] Took 10.523589 seconds t extract the tarball

	I0813 20:59:14.775075  429844 ssh_runner.go:100] rm: /preloaded.tar.lz4

	I0813 20:59:14.847701  429844 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:59:15.046932  429844 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:59:15.115651  429844 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:59:15.156721  429844 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:59:15.176516  429844 docker.go:153] disabling docker service ...

	I0813 20:59:15.176575  429844 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:59:15.195373  429844 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:59:15.208929  429844 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:59:15.423095  429844 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:59:15.651161  429844 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:59:15.667410  429844 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:59:15.686989  429844 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuNC4xIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKCglbcGx1Z2lucy4iaW8uY

29udGFpbmVyZC5ncnBjLnYxLmNyaSJdCiAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzXQogICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuY10KICAgICAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuYy5vcHRpb25zXQogICAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSB0cnVlCgogICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmRdCiAgICAgIHNuYXBzaG90dGVyID0gIm92ZXJsYXlmcyIKICAgICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmQuZGVmYXVsdF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkLnVudHJ1c3RlZF93b3JrbG9hZF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICIiCiAgICAgICAgcnVudGltZV9lbmdpbmUgPSAiIgogICAgICAgIHJ1bnRpbWVfcm9vdCA9ICIiCiAgICBbcGx1Z2lucy5jcmkuY25pXQogICAgICBiaW5fZGlyID0gIi9vcHQvY25pL2JpbiIKICAgICAgY29uZl9kaXIgPSAiL2V0Yy9jbmkvbmV0LmQiC

iAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy5kaWZmLXNlcnZpY2VdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy5zY2hlZHVsZXJdCiAgICBwYXVzZV90aHJlc2hvbGQgPSAwLjAyCiAgICBkZWxldGlvbl90aHJlc2hvbGQgPSAwCiAgICBtdXRhdGlvbl90aHJlc2hvbGQgPSAxMDAKICAgIHNjaGVkdWxlX2RlbGF5ID0gIjBzIgogICAgc3RhcnR1cF9kZWxheSA9ICIxMDBtcyIK" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:59:15.707356  429844 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:59:15.716851  429844 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0813 20:59:15.716901  429844 ssh_runner.go:149] Run: sudo modprobe br_netfilter

	I0813 20:59:15.737623  429844 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:59:15.746974  429844 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:59:15.934895  429844 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:59:16.002845  429844 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:59:16.002896  429844 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:59:16.010688  429844 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:59:17.115625  429844 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:59:17.122401  429844 start.go:413] Will wait 60s for crictl version

	I0813 20:59:17.122460  429844 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:59:17.161733  429844 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.9

	RuntimeApiVersion:  v1alpha2

	I0813 20:59:17.161805  429844 ssh_runner.go:149] Run: containerd --version

	I0813 20:59:17.195014  429844 ssh_runner.go:149] Run: containerd --version

	I0813 20:59:17.227710  429844 out.go:177] * Preparing Kubernetes v1.21.3 on containerd 1.4.9 ...

	I0813 20:59:17.227794  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetIP

	I0813 20:59:17.233294  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:59:17.233714  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:fb:29", ip: ""} in network mk-force-systemd-env-20210813205836-393438: {Iface:virbr5 ExpiryTime:2021-08-13 21:58:53 +0000 UTC Type:0 Mac:52:54:00:ec:fb:29 Iaid: IPaddr:192.168.83.204 Prefix:24 Hostname:force-systemd-env-20210813205836-393438 Clientid:01:52:54:00:ec:fb:29}

	I0813 20:59:17.233767  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined IP address 192.168.83.204 and MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:59:17.233945  429844 ssh_runner.go:149] Run: grep 192.168.83.1	host.minikube.internal$ /etc/hosts

	I0813 20:59:17.238972  429844 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:59:17.252336  429844 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:59:17.252395  429844 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:17.286326  429844 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:59:17.286348  429844 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:59:17.286402  429844 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:17.318852  429844 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:59:17.318878  429844 cache_images.go:74] Images are preloaded, skipping loading

	I0813 20:59:17.318944  429844 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:59:17.350917  429844 cni.go:93] Creating CNI manager for ""

	I0813 20:59:17.350945  429844 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:59:17.350958  429844 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:59:17.350973  429844 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.204 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:force-systemd-env-20210813205836-393438 NodeName:force-systemd-env-20210813205836-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.204"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.83.204 CgroupD

river:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:59:17.351127  429844 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.83.204

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "force-systemd-env-20210813205836-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.83.204

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.83.204"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:59:17.351246  429844 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=force-systemd-env-20210813205836-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.204 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:59:17.351312  429844 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 20:59:17.359902  429844 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:59:17.359971  429844 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:59:17.366944  429844 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (555 bytes)

	I0813 20:59:17.379424  429844 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:59:17.391585  429844 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2095 bytes)

	I0813 20:59:17.406745  429844 ssh_runner.go:149] Run: grep 192.168.83.204	control-plane.minikube.internal$ /etc/hosts

	I0813 20:59:17.411069  429844 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.204	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:59:17.422330  429844 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438 for IP: 192.168.83.204

	I0813 20:59:17.422387  429844 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:59:17.422411  429844 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:59:17.422464  429844 certs.go:297] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key

	I0813 20:59:17.422475  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt with IP's: []

	I0813 20:59:17.589717  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt ...

	I0813 20:59:17.589751  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt: {Name:mk6b638656acdae073d352761d68fbce2d483a2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.589968  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key ...

	I0813 20:59:17.589989  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key: {Name:mk9ac2f2539726279887f5743a365e91b105c985 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.590095  429844 certs.go:297] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1

	I0813 20:59:17.590108  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 with IP's: [192.168.83.204 10.96.0.1 127.0.0.1 10.0.0.1]

	I0813 20:59:17.670870  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 ...

	I0813 20:59:17.670902  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1: {Name:mk74913ff00a65a919a90225ed0787c2cfa299a4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.671104  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1 ...

	I0813 20:59:17.671122  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1: {Name:mk4e832137b5b0e86e874baf2ff0ef565095edcf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.671224  429844 certs.go:308] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt

	I0813 20:59:17.671292  429844 certs.go:312] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key

	I0813 20:59:17.671342  429844 certs.go:297] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key

	I0813 20:59:17.671350  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt with IP's: []

	I0813 20:59:17.811967  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt ...

	I0813 20:59:17.811999  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt: {Name:mka2285c334ce140bfabe8b380f8ad699fb95705 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.812195  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key ...

	I0813 20:59:17.812213  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key: {Name:mkb6682fffa6b297b1d5d051bc98ddc5e21e1737 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.812326  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0813 20:59:17.812347  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0813 20:59:17.812362  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0813 20:59:17.812374  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0813 20:59:17.812388  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0813 20:59:17.812401  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0813 20:59:17.812413  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0813 20:59:17.812425  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0813 20:59:17.812864  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:59:17.812941  429844 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:59:17.812954  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:59:17.812992  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:59:17.813034  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:59:17.813070  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:59:17.813140  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:59:17.813182  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem -> /usr/share/ca-certificates/393438.pem

	I0813 20:59:17.813203  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> /usr/share/ca-certificates/3934382.pem

	I0813 20:59:17.813220  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:17.815185  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:59:17.835646  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:59:17.854490  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:59:17.870584  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0813 20:59:17.888194  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:59:17.904940  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:59:17.923217  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:59:17.939714  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:59:17.956070  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:59:17.973489  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:59:17.990533  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:59:18.006640  429844 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:59:18.018556  429844 ssh_runner.go:149] Run: openssl version

	I0813 20:59:18.026398  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:59:18.036506  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.043248  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.043295  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.051624  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:59:18.060163  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:59:18.068077  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.073070  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.073115  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.079189  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:59:18.086616  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:59:18.094245  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.098831  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.098874  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.104647  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:59:18.112378  429844 kubeadm.go:390] StartCluster: {Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio

n:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.83.204 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:18.112457  429844 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:59:18.112500  429844 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:59:18.152531  429844 cri.go:76] found id: ""

	I0813 20:59:18.152584  429844 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:59:18.160520  429844 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:18.167754  429844 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 20:59:18.174622  429844 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 20:59:18.174683  429844 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem"

	I0813 20:59:15.870106  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:19.916324  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0813 20:59:19.916355  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0813 20:59:20.369815  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:20.377224  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:20.377246  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:16.101618  430322 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:59:16.107180  430322 info.go:137] Remote host: Buildroot 2020.02.12

	I0813 20:59:16.107204  430322 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:59:16.107264  430322 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:59:16.107365  430322 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> 3934382.pem in /etc/ssl/certs

	I0813 20:59:16.107482  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs

	I0813 20:59:16.116337  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:59:16.137631  430322 start.go:270] post-start completed in 142.968259ms

	I0813 20:59:16.137673  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.137960  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.143893  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.144357  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.144393  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.144525  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.144729  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.144879  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.145013  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.145162  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:16.145340  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:16.145356  430322 main.go:130] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0813 20:59:16.273390  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: 1628888356.165572851

	I0813 20:59:16.273423  430322 fix.go:212] guest clock: 1628888356.165572851

	I0813 20:59:16.273435  430322 fix.go:225] Guest: 2021-08-13 20:59:16.165572851 +0000 UTC Remote: 2021-08-13 20:59:16.137936029 +0000 UTC m=+15.073653376 (delta=27.636822ms)

	I0813 20:59:16.273466  430322 fix.go:196] guest clock delta is within tolerance: 27.636822ms

	I0813 20:59:16.273484  430322 fix.go:57] fixHost completed within 15.007250096s

	I0813 20:59:16.273495  430322 start.go:80] releasing machines lock for "kubernetes-upgrade-20210813205735-393438", held for 15.007279625s

	I0813 20:59:16.273547  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.273864  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:16.280481  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.280887  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.280930  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.281057  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.281265  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.281833  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.282114  430322 ssh_runner.go:149] Run: systemctl --version

	I0813 20:59:16.282129  430322 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:59:16.282147  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.282183  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.289563  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290185  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290473  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.290560  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290775  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.290971  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.291085  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.291206  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.291246  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.291408  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:16.291516  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.291696  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.291840  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.291971  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:16.377402  430322 preload.go:131] Checking if preload exists for k8s version v1.22.0-rc.0 and runtime containerd

	I0813 20:59:16.377543  430322 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:20.423651  430322 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.04608471s)

	I0813 20:59:20.423837  430322 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.22.0-rc.0". assuming images are not preloaded.

	I0813 20:59:20.423909  430322 ssh_runner.go:149] Run: which lz4

	I0813 20:59:20.428467  430322 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:59:20.433162  430322 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:59:20.433188  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (945588089 bytes)

	I0813 20:59:18.857423  429844 out.go:204]   - Generating certificates and keys ...

	I0813 20:59:21.576816  429844 out.go:204]   - Booting up control plane ...

	I0813 20:59:20.869652  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.055874  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:21.055917  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:21.370125  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.389753  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:21.389788  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:21.874753  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.890465  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 200:

	ok

	I0813 20:59:21.902570  429197 api_server.go:139] control plane version: v1.20.0

	I0813 20:59:21.902598  429197 api_server.go:129] duration metric: took 6.534669952s to wait for apiserver health ...

	I0813 20:59:21.902612  429197 cni.go:93] Creating CNI manager for ""

	I0813 20:59:21.902621  429197 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	33fae69af6bcf       6e38f40d628db       56 seconds ago       Exited              storage-provisioner       0                   76aee79f917be

	b6372d9d76486       296a6d5035e2d       About a minute ago   Running             coredns                   1                   cfc4c8785e479

	afabb5f130410       0369cf4303ffd       About a minute ago   Running             etcd                      1                   3f41ec729ef71

	57f3f32f280d8       bc2bb319a7038       About a minute ago   Running             kube-controller-manager   1                   ce1823a3db17a

	1053b5b4ba3ab       3d174f00aa39e       About a minute ago   Running             kube-apiserver            1                   a655f217cf1c5

	0d1a942c8b8c2       adb2816ea823a       About a minute ago   Running             kube-proxy                1                   47e050012dbca

	1d84b053549cf       6be0dc1302e30       About a minute ago   Running             kube-scheduler            1                   53f314c6cf963

	1bba0d6deb033       adb2816ea823a       2 minutes ago        Exited              kube-proxy                0                   3f6f239c2851f

	63c0cc1fc4c0c       296a6d5035e2d       2 minutes ago        Exited              coredns                   0                   b1f1f31f28005

	698bbea7ce6e9       6be0dc1302e30       2 minutes ago        Exited              kube-scheduler            0                   5a66336a35add

	df02c38abac90       0369cf4303ffd       2 minutes ago        Exited              etcd                      0                   4cf745987f602

	68bad43283064       bc2bb319a7038       2 minutes ago        Exited              kube-controller-manager   0                   5340b4aa5ca39

	11c2753c9a8a7       3d174f00aa39e       2 minutes ago        Exited              kube-apiserver            0                   304b611d719ea

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:59:23 UTC. --

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.078142311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:etcd-pause-20210813205520-393438,Uid:86a000e5c08d32d80b2fd4e89cd34dd1,Namespace:kube-system,Attempt:1,} returns sandbox id \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.145266794Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for container &ContainerMetadata{Name:etcd,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.321521915Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\" returns successfully"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.349622186Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for &ContainerMetadata{Name:etcd,Attempt:1,} returns container id \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.353268082Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.376810925Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-558bd4d5db-jzmnb,Uid:ea00ae4c-f4d9-414c-8762-6314a96c8a06,Namespace:kube-system,Attempt:1,} returns sandbox id \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.451595226Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for container &ContainerMetadata{Name:coredns,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.633919582Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for &ContainerMetadata{Name:coredns,Attempt:1,} returns container id \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.635324605Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.770314446Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.016041628Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.229109322Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\" returns successfully"

	Aug 13 20:58:15 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:15.472167045Z" level=info msg="StartContainer for \"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5\" returns successfully"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.856093567Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,}"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.901091488Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a pid=4886

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.481756294Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,} returns sandbox id \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.492027606Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.607213854Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.614295374Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.876068804Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\" returns successfully"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.156236073Z" level=info msg="Finish piping stderr of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.158102368Z" level=info msg="Finish piping stdout of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.159567062Z" level=info msg="TaskExit event &TaskExit{ContainerID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,Pid:4945,ExitStatus:255,ExitedAt:2021-08-13 20:58:41.157732657 +0000 UTC,XXX_unrecognized:[],}"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217770540Z" level=info msg="shim disconnected" id=33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217941244Z" level=error msg="copy shim log" error="read /proc/self/fd/98: file already closed"

	* 

	* ==> coredns [63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I0813 20:57:49.980199       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.978) (total time: 30001ms):

	Trace[2019727887]: [30.001847928s] [30.001847928s] END

	E0813 20:57:49.980279       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.980655       1 trace.go:205] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[939984059]: [30.00501838s] [30.00501838s] END

	E0813 20:57:49.980691       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.981307       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[911902081]: [30.005916603s] [30.005916603s] END

	E0813 20:57:49.981521       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	E0813 20:58:20.310855       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:coredns" cannot list resource "services" in API group "" at the cluster scope

	* 

	* ==> describe nodes <==

	* Name:               pause-20210813205520-393438

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=pause-20210813205520-393438

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=pause-20210813205520-393438

	                    minikube.k8s.io/updated_at=2021_08_13T20_57_02_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:56:57 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  pause-20210813205520-393438

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:58:20 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:57:09 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.61.151

	  Hostname:    pause-20210813205520-393438

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2033044Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2033044Ki

	  pods:               110

	System Info:

	  Machine ID:                 77eb9b5f6d424569bb9c035580bd499b

	  System UUID:                77eb9b5f-6d42-4569-bb9c-035580bd499b

	  Boot ID:                    f7c4e7cb-b855-4691-ba67-6445018f8c6d

	  Kernel Version:             4.19.182

	  OS Image:                   Buildroot 2020.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  containerd://1.4.9

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-558bd4d5db-jzmnb                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     2m7s

	  kube-system                 etcd-pause-20210813205520-393438                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (5%!)(MISSING)       0 (0%!)(MISSING)         2m15s

	  kube-system                 kube-apiserver-pause-20210813205520-393438             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m15s

	  kube-system                 kube-controller-manager-pause-20210813205520-393438    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m15s

	  kube-system                 kube-proxy-mlf5c                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m7s

	  kube-system                 kube-scheduler-pause-20210813205520-393438             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m21s

	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         58s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (8%!)(MISSING)  170Mi (8%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasSufficientMemory  2m41s (x8 over 2m42s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m41s (x8 over 2m42s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m41s (x7 over 2m42s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m15s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m15s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m15s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m15s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m15s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                2m14s                  kubelet     Node pause-20210813205520-393438 status is now: NodeReady

	  Normal  Starting                 2m3s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 60s                    kube-proxy  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [  +0.000017] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.863604] systemd-fstab-generator[1160]: Ignoring "noauto" for root device

	[  +0.032050] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +0.917916] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=1722 comm=systemd-network

	[  +2.669268] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.

	[  +0.335717] vboxguest: loading out-of-tree module taints kernel.

	[  +0.008488] vboxguest: PCI device not found, probably running on physical hardware.

	[Aug13 20:56] systemd-fstab-generator[2101]: Ignoring "noauto" for root device

	[  +0.927578] systemd-fstab-generator[2132]: Ignoring "noauto" for root device

	[  +0.140064] systemd-fstab-generator[2146]: Ignoring "noauto" for root device

	[  +0.195734] systemd-fstab-generator[2179]: Ignoring "noauto" for root device

	[  +8.321149] systemd-fstab-generator[2386]: Ignoring "noauto" for root device

	[Aug13 20:57] systemd-fstab-generator[2823]: Ignoring "noauto" for root device

	[ +16.072552] kauditd_printk_skb: 38 callbacks suppressed

	[ +34.372009] kauditd_printk_skb: 116 callbacks suppressed

	[  +3.958113] NFSD: Unable to end grace period: -110

	[Aug13 20:58] systemd-fstab-generator[3706]: Ignoring "noauto" for root device

	[  +0.206181] systemd-fstab-generator[3719]: Ignoring "noauto" for root device

	[  +0.261980] systemd-fstab-generator[3744]: Ignoring "noauto" for root device

	[ +19.584639] kauditd_printk_skb: 41 callbacks suppressed

	[  +5.482860] systemd-fstab-generator[4981]: Ignoring "noauto" for root device

	[  +0.846439] systemd-fstab-generator[5035]: Ignoring "noauto" for root device

	[Aug13 20:59] systemd-fstab-generator[5622]: Ignoring "noauto" for root device

	[  +0.795991] systemd-fstab-generator[5652]: Ignoring "noauto" for root device

	* 

	* ==> etcd [afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5] <==

	* 2021-08-13 20:58:16.461857 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true " with result "range_response_count:0 size:5" took too long (198.960862ms) to execute

	2021-08-13 20:58:16.462013 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 " with result "range_response_count:0 size:5" took too long (199.025411ms) to execute

	2021-08-13 20:58:16.462116 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (190.42222ms) to execute

	2021-08-13 20:58:16.462337 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (179.184455ms) to execute

	2021-08-13 20:58:16.462702 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (172.711746ms) to execute

	2021-08-13 20:58:16.462925 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (170.528555ms) to execute

	2021-08-13 20:58:16.463221 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (158.293847ms) to execute

	2021-08-13 20:58:16.463747 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (158.490371ms) to execute

	2021-08-13 20:58:16.464124 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (152.464331ms) to execute

	2021-08-13 20:58:16.477058 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (151.343452ms) to execute

	2021-08-13 20:58:16.478005 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" count_only:true " with result "range_response_count:0 size:5" took too long (142.028022ms) to execute

	2021-08-13 20:58:16.478939 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" limit:10000 " with result "range_response_count:0 size:5" took too long (142.259692ms) to execute

	2021-08-13 20:58:16.479721 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (129.328346ms) to execute

	2021-08-13 20:58:16.479967 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (126.882803ms) to execute

	2021-08-13 20:58:16.480303 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:10000 " with result "range_response_count:11 size:5977" took too long (116.866258ms) to execute

	2021-08-13 20:58:16.480852 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true " with result "range_response_count:0 size:7" took too long (116.970061ms) to execute

	2021-08-13 20:58:23.354247 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/cluster-admin\" " with result "range_response_count:1 size:718" took too long (1.914180768s) to execute

	2021-08-13 20:58:23.356685 W | etcdserver: request "header:<ID:14244176716868856811 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" value_size:717 lease:5020804680014080881 >> failure:<>>" with result "size:16" took too long (1.23562281s) to execute

	2021-08-13 20:58:23.370142 W | wal: sync duration of 1.250273887s, expected less than 1s

	2021-08-13 20:58:23.370676 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.152835664s) to execute

	2021-08-13 20:58:23.371565 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.728436243s) to execute

	2021-08-13 20:58:23.371769 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.847351028s) to execute

	2021-08-13 20:58:23.378962 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-558bd4d5db-jzmnb\" " with result "range_response_count:1 size:4862" took too long (671.753147ms) to execute

	2021-08-13 20:58:24.705568 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:1 size:4394" took too long (221.501911ms) to execute

	2021-08-13 20:58:26.341296 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418] <==

	* 2021-08-13 20:56:51.867973 I | embed: serving client requests on 192.168.61.151:2379

	2021-08-13 20:56:51.875825 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:57:01.271062 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpointslicemirroring-controller\" " with result "range_response_count:0 size:5" took too long (480.2351ms) to execute

	2021-08-13 20:57:01.272131 W | etcdserver: read-only range request "key:\"/registry/minions/pause-20210813205520-393438\" " with result "range_response_count:1 size:3758" took too long (875.676682ms) to execute

	2021-08-13 20:57:01.273551 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f12dc\" " with result "range_response_count:1 size:735" took too long (792.283833ms) to execute

	2021-08-13 20:57:02.171621 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (872.818648ms) to execute

	2021-08-13 20:57:02.172160 W | etcdserver: request "header:<ID:14244176716848216677 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:222 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3993 >> failure:<request_range:<key:\"/registry/minions/pause-20210813205520-393438\" > >>" with result "size:16" took too long (128.660032ms) to execute

	2021-08-13 20:57:02.172330 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:351" took too long (871.615956ms) to execute

	2021-08-13 20:57:02.172733 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f2f58\" " with result "range_response_count:1 size:733" took too long (859.92991ms) to execute

	2021-08-13 20:57:02.172849 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (853.236151ms) to execute

	2021-08-13 20:57:09.290631 W | etcdserver: request "header:<ID:14244176716848216792 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:0 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3277 >> failure:<>>" with result "size:5" took too long (472.704737ms) to execute

	2021-08-13 20:57:09.291659 W | etcdserver: read-only range request "key:\"/registry/leases/kube-node-lease/pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (897.879132ms) to execute

	2021-08-13 20:57:09.298807 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-pause-20210813205520-393438\" " with result "range_response_count:1 size:4986" took too long (528.421007ms) to execute

	2021-08-13 20:57:09.299124 W | etcdserver: read-only range request "key:\"/registry/csinodes/pause-20210813205520-393438\" " with result "range_response_count:1 size:656" took too long (894.254864ms) to execute

	2021-08-13 20:57:13.314052 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" " with result "range_response_count:1 size:210" took too long (127.466898ms) to execute

	2021-08-13 20:57:13.314663 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (132.387511ms) to execute

	2021-08-13 20:57:16.343764 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:20.988739 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:30.989151 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:39.442816 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:422" took too long (120.094417ms) to execute

	2021-08-13 20:57:40.988900 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:50.989064 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:58:00.244154 W | etcdserver: request "header:<ID:14244176716848217456 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.61.151\" mod_revision:483 > success:<request_put:<key:\"/registry/masterleases/192.168.61.151\" value_size:69 lease:5020804679993441646 >> failure:<request_range:<key:\"/registry/masterleases/192.168.61.151\" > >>" with result "size:16" took too long (162.220853ms) to execute

	2021-08-13 20:58:00.245134 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (881.389444ms) to execute

	2021-08-13 20:58:00.989778 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:59:23 up 3 min,  0 users,  load average: 0.98, 0.82, 0.35

	Linux pause-20210813205520-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c] <==

	* Trace[553017594]: ---"About to write a response" 1919ms (20:58:00.358)

	Trace[553017594]: [1.920866407s] [1.920866407s] END

	I0813 20:58:23.381663       1 trace.go:205] Trace[1143050190]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-jzmnb,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:22.699) (total time: 682ms):

	Trace[1143050190]: ---"About to write a response" 681ms (20:58:00.380)

	Trace[1143050190]: [682.310081ms] [682.310081ms] END

	I0813 20:58:25.230359       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 20:58:25.281700       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 20:58:25.373725       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0813 20:58:25.413105       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:58:25.560667       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io

	I0813 20:59:15.369992       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:59:15.370169       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:59:15.370213       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	E0813 20:59:15.548831       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E0813 20:59:15.551721       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:15.551910       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:15.553384       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0813 20:59:16.253189       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled

	E0813 20:59:16.253342       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:16.254420       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:16.258368       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:16.261299       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0813 20:59:16.262291       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:16.288769       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I0813 20:59:16.754327       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	* 

	* ==> kube-apiserver [11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016] <==

	* I0813 20:57:09.309542       1 trace.go:205] Trace[2046907584]: "Create" url:/api/v1/nodes,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.501) (total time: 806ms):

	Trace[2046907584]: [806.482297ms] [806.482297ms] END

	I0813 20:57:09.310802       1 trace.go:205] Trace[146959614]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.771) (total time: 538ms):

	Trace[146959614]: ---"Object stored in database" 538ms (20:57:00.310)

	Trace[146959614]: [538.954794ms] [538.954794ms] END

	I0813 20:57:09.311138       1 trace.go:205] Trace[1128950750]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-pause-20210813205520-393438,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1128950750]: ---"About to write a response" 537ms (20:57:00.307)

	Trace[1128950750]: [541.267103ms] [541.267103ms] END

	I0813 20:57:09.311248       1 trace.go:205] Trace[1268223707]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1268223707]: ---"Object stored in database" 540ms (20:57:00.310)

	Trace[1268223707]: [541.971563ms] [541.971563ms] END

	I0813 20:57:09.311433       1 trace.go:205] Trace[1977445463]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.772) (total time: 538ms):

	Trace[1977445463]: ---"Object stored in database" 537ms (20:57:00.310)

	Trace[1977445463]: [538.348208ms] [538.348208ms] END

	I0813 20:57:09.321803       1 trace.go:205] Trace[494614999]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 552ms):

	Trace[494614999]: [552.453895ms] [552.453895ms] END

	I0813 20:57:09.345220       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:57:16.259955       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	I0813 20:57:16.380865       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0813 20:57:37.272234       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:57:37.272418       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:57:37.272507       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:58:00.246413       1 trace.go:205] Trace[1997979141]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (13-Aug-2021 20:57:59.258) (total time: 987ms):

	Trace[1997979141]: ---"Transaction committed" 984ms (20:58:00.246)

	Trace[1997979141]: [987.521712ms] [987.521712ms] END

	* 

	* ==> kube-controller-manager [57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849] <==

	* I0813 20:59:16.709660       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:59:16.712193       1 shared_informer.go:247] Caches are synced for GC 

	I0813 20:59:16.722572       1 shared_informer.go:247] Caches are synced for node 

	I0813 20:59:16.722685       1 range_allocator.go:172] Starting range CIDR allocator

	I0813 20:59:16.722692       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I0813 20:59:16.722698       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I0813 20:59:16.728359       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:59:16.729318       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:59:16.729562       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	I0813 20:59:16.729905       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:59:16.731175       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	W0813 20:59:16.731760       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:59:16.732194       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:59:16.732423       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:59:16.732906       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 

	I0813 20:59:16.747287       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:59:16.761010       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:59:16.769847       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:59:16.772854       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:59:16.793140       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:59:16.811782       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:59:16.811797       1 disruption.go:371] Sending events to api server.

	I0813 20:59:17.205296       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:59:17.277302       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:59:17.277855       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	* 

	* ==> kube-controller-manager [68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8] <==

	* I0813 20:57:15.593972       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:57:15.593991       1 disruption.go:371] Sending events to api server.

	I0813 20:57:15.596695       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:57:15.636700       1 shared_informer.go:247] Caches are synced for service account 

	I0813 20:57:15.652896       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:57:15.701400       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:57:15.701628       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:57:15.701702       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:57:15.701748       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:57:15.701825       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:57:15.702024       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	I0813 20:57:15.735577       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0813 20:57:15.751667       1 shared_informer.go:247] Caches are synced for stateful set 

	I0813 20:57:15.767285       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:15.796364       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:57:15.847876       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:16.199991       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.200121       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:57:16.224599       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.277997       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:57:16.457337       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-mlf5c"

	I0813 20:57:16.545672       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-fhxw7"

	I0813 20:57:16.596799       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-jzmnb"

	I0813 20:57:16.804186       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:57:16.819742       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-fhxw7"

	* 

	* ==> kube-proxy [0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5] <==

	* E0813 20:58:20.334846       1 node.go:161] Failed to retrieve node info: nodes "pause-20210813205520-393438" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I0813 20:58:21.364522       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:58:21.365223       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:58:21.366125       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:58:23.461362       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:58:23.462248       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:58:23.465333       1 server_others.go:212] Using iptables Proxier.

	I0813 20:58:23.483125       1 server.go:643] Version: v1.21.3

	I0813 20:58:23.488959       1 config.go:315] Starting service config controller

	I0813 20:58:23.490323       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:58:23.490593       1 config.go:224] Starting endpoint slice config controller

	I0813 20:58:23.490606       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:58:23.512424       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:58:23.514744       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:58:23.591163       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:58:23.593313       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62] <==

	* I0813 20:57:20.123665       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:57:20.123841       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:57:20.123909       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:57:20.180054       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:57:20.180158       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:57:20.180173       1 server_others.go:212] Using iptables Proxier.

	I0813 20:57:20.181825       1 server.go:643] Version: v1.21.3

	I0813 20:57:20.184367       1 config.go:315] Starting service config controller

	I0813 20:57:20.184561       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:57:20.184600       1 config.go:224] Starting endpoint slice config controller

	I0813 20:57:20.184604       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:57:20.203222       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:57:20.207174       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:57:20.285130       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:57:20.285144       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c] <==

	* I0813 20:58:11.830530       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:58:20.220887       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:58:20.224373       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:58:20.224624       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:58:20.224640       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:58:20.341243       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:58:20.343223       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.343608       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.347257       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:58:20.444874       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	W0813 20:59:05.413646       1 reflector.go:436] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: watch of *v1.ConfigMap ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831376       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PersistentVolumeClaim ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831398       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Node ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831633       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Pod ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831662       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831677       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.CSIDriver ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831719       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.CSIStorageCapacity ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831730       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.StorageClass ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831767       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.CSINode ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831776       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.ReplicationController ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831804       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.ReplicaSet ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831815       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.StatefulSet ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831834       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PodDisruptionBudget ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831859       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PersistentVolume ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	* 

	* ==> kube-scheduler [698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889] <==

	* I0813 20:56:57.340096       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:56:57.373873       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:57.375600       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:57.398047       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:57.406392       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:56:57.418940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.424521       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:57.426539       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:56:57.426578       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:56:57.428616       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428765       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:56:57.428811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:57.428897       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:56:58.261670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:58.311937       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:58.405804       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.463800       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:58.585826       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.615525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:58.626736       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.669986       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:58.791820       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0813 20:57:01.440271       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:59:23 UTC. --

	Aug 13 20:59:16 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:16.442997    5630 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.121813    5630 server.go:660] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.123739    5630 container_manager_linux.go:278] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124150    5630 container_manager_linux.go:283] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124413    5630 topology_manager.go:120] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124800    5630 container_manager_linux.go:314] "Initializing Topology Manager" policy="none" scope="container"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124979    5630 container_manager_linux.go:319] "Creating device plugin manager" devicePluginEnabled=true

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125347    5630 remote_runtime.go:62] parsed scheme: ""

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125615    5630 remote_runtime.go:62] scheme "" not registered, fallback to default scheme

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125862    5630 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126021    5630 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126351    5630 remote_image.go:50] parsed scheme: ""

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126598    5630 remote_image.go:50] scheme "" not registered, fallback to default scheme

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126791    5630 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126948    5630 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127298    5630 kubelet.go:404] "Attempting to sync node with API server"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127591    5630 kubelet.go:272] "Adding static pod path" path="/etc/kubernetes/manifests"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127844    5630 kubelet.go:283] "Adding apiserver pod source"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.128310    5630 apiserver.go:42] "Waiting for node sync before watching apiserver pods"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.153644    5630 kuberuntime_manager.go:222] "Container runtime initialized" containerRuntime="containerd" version="v1.4.9" apiVersion="v1alpha2"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: E0813 20:59:21.470849    5630 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.489062    5630 server.go:1190] "Started kubelet"

	Aug 13 20:59:21 pause-20210813205520-393438 systemd[1]: kubelet.service: Succeeded.

	Aug 13 20:59:21 pause-20210813205520-393438 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81] <==

	* 	/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:880 +0x4af

	goroutine 90 [sync.Cond.Wait]:

	sync.runtime_notifyListWait(0xc000328290, 0xc000000003)

		/usr/local/go/src/runtime/sema.go:513 +0xf8

	sync.(*Cond).Wait(0xc000328280)

		/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0003f0480, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003bcc80, 0x18e5530, 0xc0003284c0, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004ceee0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0004ceee0, 0x18b3d60, 0xc000311f80, 0x1, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004ceee0, 0x3b9aca00, 0x0, 0x17a0501, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc0004ceee0, 0x3b9aca00, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (389.063123ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210813205520-393438 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:271: non-running pods: 

helpers_test.go:273: ======> post-mortem[TestPause/serial/PauseAgain]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210813205520-393438 describe pod 

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210813205520-393438 describe pod : exit status 1 (75.586059ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:278: kubectl --context pause-20210813205520-393438 describe pod : exit status 1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (490.620722ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20210813205520-393438 logs -n 25: (1.833267827s)

helpers_test.go:253: TestPause/serial/PauseAgain logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                   Args                   |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| start   | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:44:04 UTC | Fri, 13 Aug 2021 20:48:01 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	|         | --wait=true -v=8                         |                                          |         |         |                               |                               |

	|         | --alsologtostderr --driver=kvm2          |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	| start   | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:48:01 UTC | Fri, 13 Aug 2021 20:49:01 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438-m03      | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:02 UTC | Fri, 13 Aug 2021 20:49:03 UTC |

	|         | multinode-20210813202658-393438-m03      |                                          |         |         |                               |                               |

	| delete  | -p                                       | multinode-20210813202658-393438          | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:49:03 UTC | Fri, 13 Aug 2021 20:49:05 UTC |

	|         | multinode-20210813202658-393438          |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:50:38 UTC | Fri, 13 Aug 2021 20:52:46 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | --wait=true --preload=false              |                                          |         |         |                               |                               |

	|         | --driver=kvm2                            |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:47 UTC | Fri, 13 Aug 2021 20:52:48 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl pull busybox              |                                          |         |         |                               |                               |

	| start   | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:52:48 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=kvm2           |                                          |         |         |                               |                               |

	|         |  --container-runtime=containerd          |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3             |                                          |         |         |                               |                               |

	| ssh     | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:39 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	|         | -- sudo crictl image ls                  |                                          |         |         |                               |                               |

	| delete  | -p                                       | test-preload-20210813205038-393438       | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:39 UTC | Fri, 13 Aug 2021 20:53:41 UTC |

	|         | test-preload-20210813205038-393438       |                                          |         |         |                               |                               |

	| start   | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:53:41 UTC | Fri, 13 Aug 2021 20:54:41 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --memory=2048 --driver=kvm2              |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:42 UTC | Fri, 13 Aug 2021 20:54:42 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --cancel-scheduled                       |                                          |         |         |                               |                               |

	| stop    | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:54:55 UTC | Fri, 13 Aug 2021 20:55:02 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	|         | --schedule 5s                            |                                          |         |         |                               |                               |

	| delete  | -p                                       | scheduled-stop-20210813205341-393438     | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:20 UTC | Fri, 13 Aug 2021 20:55:20 UTC |

	|         | scheduled-stop-20210813205341-393438     |                                          |         |         |                               |                               |

	| start   | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:33 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048     |                                          |         |         |                               |                               |

	|         | --wait=true --driver=kvm2                |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | offline-containerd-20210813205520-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:33 UTC | Fri, 13 Aug 2021 20:57:35 UTC |

	|         | offline-containerd-20210813205520-393438 |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:55:21 UTC | Fri, 13 Aug 2021 20:57:54 UTC |

	|         | --memory=2048                            |                                          |         |         |                               |                               |

	|         | --install-addons=false                   |                                          |         |         |                               |                               |

	|         | --wait=all --driver=kvm2                 |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:54 UTC | Fri, 13 Aug 2021 20:58:28 UTC |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:27 UTC | Fri, 13 Aug 2021 20:58:34 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| logs    | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:34 UTC | Fri, 13 Aug 2021 20:58:35 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| delete  | -p                                       | stopped-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:35 UTC | Fri, 13 Aug 2021 20:58:36 UTC |

	|         | stopped-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	| start   | -p                                       | kubernetes-upgrade-20210813205735-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:35 UTC | Fri, 13 Aug 2021 20:58:58 UTC |

	|         | kubernetes-upgrade-20210813205735-393438 |                                          |         |         |                               |                               |

	|         | --memory=2200                            |                                          |         |         |                               |                               |

	|         | --kubernetes-version=v1.14.0             |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --driver=kvm2     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| stop    | -p                                       | kubernetes-upgrade-20210813205735-393438 | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:58:58 UTC | Fri, 13 Aug 2021 20:59:00 UTC |

	|         | kubernetes-upgrade-20210813205735-393438 |                                          |         |         |                               |                               |

	| unpause | -p pause-20210813205520-393438           | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:59:14 UTC | Fri, 13 Aug 2021 20:59:15 UTC |

	|         | --alsologtostderr -v=5                   |                                          |         |         |                               |                               |

	| -p      | pause-20210813205520-393438              | pause-20210813205520-393438              | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:59:22 UTC | Fri, 13 Aug 2021 20:59:24 UTC |

	|         | logs -n 25                               |                                          |         |         |                               |                               |

	| start   | -p                                       | running-upgrade-20210813205520-393438    | jenkins | v1.22.0 | Fri, 13 Aug 2021 20:57:40 UTC | Fri, 13 Aug 2021 20:59:24 UTC |

	|         | running-upgrade-20210813205520-393438    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=kvm2                       |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 20:59:01

	Running on machine: debian-jenkins-agent-11

	Binary: Built with gc go1.16.7 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 20:59:01.126131  430322 out.go:298] Setting OutFile to fd 1 ...

	I0813 20:59:01.126334  430322 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:01.126345  430322 out.go:311] Setting ErrFile to fd 2...

	I0813 20:59:01.126349  430322 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 20:59:01.126438  430322 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 20:59:01.126658  430322 out.go:305] Setting JSON to false

	I0813 20:59:01.168018  430322 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-11","uptime":6103,"bootTime":1628882238,"procs":194,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0813 20:59:01.168125  430322 start.go:121] virtualization: kvm guest

	I0813 20:59:01.170881  430322 out.go:177] * [kubernetes-upgrade-20210813205735-393438] minikube v1.22.0 on Debian 9.13 (kvm/amd64)

	I0813 20:59:01.172410  430322 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:59:01.171037  430322 notify.go:169] Checking for updates...

	I0813 20:59:01.173939  430322 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0813 20:59:01.175272  430322 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 20:59:01.176563  430322 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 20:59:01.176998  430322 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.14.0

	I0813 20:59:01.177535  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.177578  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.190824  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:42145

	I0813 20:59:01.191328  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.192096  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.192126  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.192607  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.192838  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.193041  430322 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 20:59:01.193517  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.193562  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.208017  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:37221

	I0813 20:59:01.209032  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.209672  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.209701  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.210226  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.210435  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.248561  430322 out.go:177] * Using the kvm2 driver based on existing profile

	I0813 20:59:01.248588  430322 start.go:278] selected driver: kvm2

	I0813 20:59:01.248595  430322 start.go:751] validating driver "kvm2" against &{Name:kubernetes-upgrade-20210813205735-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20210813205735-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:01.248717  430322 start.go:762] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 20:59:01.250011  430322 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:59:01.250160  430322 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0813 20:59:01.262799  430322 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.22.0

	I0813 20:59:01.263220  430322 cni.go:93] Creating CNI manager for ""

	I0813 20:59:01.263239  430322 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:59:01.263251  430322 start_flags.go:277] config:

	{Name:kubernetes-upgrade-20210813205735-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.0-rc.0 ClusterName:kubernetes-upgrade-2021081320573

5-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.75 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:01.263415  430322 iso.go:123] acquiring lock: {Name:mkbb42d4fa68811cd256644294b190331263ca3e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 20:59:01.265573  430322 out.go:177] * Starting control plane node kubernetes-upgrade-20210813205735-393438 in cluster kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.265601  430322 preload.go:131] Checking if preload exists for k8s version v1.22.0-rc.0 and runtime containerd

	I0813 20:59:01.265646  430322 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4

	I0813 20:59:01.265665  430322 cache.go:56] Caching tarball of preloaded images

	I0813 20:59:01.265770  430322 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 20:59:01.265790  430322 cache.go:59] Finished verifying existence of preloaded tar for  v1.22.0-rc.0 on containerd

	I0813 20:59:01.265928  430322 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/config.json ...

	I0813 20:59:01.266108  430322 cache.go:205] Successfully downloaded all kic artifacts

	I0813 20:59:01.266142  430322 start.go:313] acquiring machines lock for kubernetes-upgrade-20210813205735-393438: {Name:mk8bf9f7b0c4b5b470b774aec39ccd1ea980ebef Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0813 20:59:01.266204  430322 start.go:317] acquired machines lock for "kubernetes-upgrade-20210813205735-393438" in 45.243µs

	I0813 20:59:01.266222  430322 start.go:93] Skipping create...Using existing machine configuration

	I0813 20:59:01.266233  430322 fix.go:55] fixHost starting: 

	I0813 20:59:01.266656  430322 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:01.266753  430322 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:01.279307  430322 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:45157

	I0813 20:59:01.279807  430322 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:01.280359  430322 main.go:130] libmachine: Using API Version  1

	I0813 20:59:01.280380  430322 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:01.280834  430322 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:01.281039  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:01.281186  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetState

	I0813 20:59:01.284783  430322 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20210813205735-393438: state=Stopped err=<nil>

	I0813 20:59:01.284823  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	W0813 20:59:01.284949  430322 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 20:58:59.870373  429844 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.008983457s)

	I0813 20:58:59.871116  429844 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.21.3". assuming images are not preloaded.

	I0813 20:58:59.871287  429844 ssh_runner.go:149] Run: which lz4

	I0813 20:58:59.880284  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0813 20:58:59.880368  429844 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:58:59.885231  429844 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:58:59.885260  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (928970367 bytes)

	I0813 20:59:00.541957  429197 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0813 20:59:00.550528  429197 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 20:59:00.550578  429197 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 20:59:00.558098  429197 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0813 20:59:00.564879  429197 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 20:59:00.564943  429197 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 20:59:00.573424  429197 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:00.581588  429197 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:00.581608  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:00.775307  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.073222  429197 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.297863235s)

	I0813 20:59:02.073255  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.470011  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.646948  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:02.826557  429197 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:59:02.826636  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:03.341139  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:03.840915  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:04.340501  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:04.841157  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:05.341002  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:01.287021  430322 out.go:177] * Restarting existing kvm2 VM for "kubernetes-upgrade-20210813205735-393438" ...

	I0813 20:59:01.287050  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .Start

	I0813 20:59:01.287193  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring networks are active...

	I0813 20:59:01.289470  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring network default is active

	I0813 20:59:01.289937  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Ensuring network mk-kubernetes-upgrade-20210813205735-393438 is active

	I0813 20:59:01.290387  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Getting domain xml...

	I0813 20:59:01.292866  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Creating domain...

	I0813 20:59:01.738864  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Waiting to get IP...

	I0813 20:59:01.739927  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.740403  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has current primary IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.740436  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Found IP for machine: 192.168.39.75

	I0813 20:59:01.740459  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserving static IP address...

	I0813 20:59:01.741000  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "kubernetes-upgrade-20210813205735-393438", mac: "52:54:00:50:ef:93", ip: "192.168.39.75"} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:01.741035  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | skip adding static IP to network mk-kubernetes-upgrade-20210813205735-393438 - found existing host DHCP lease matching {name: "kubernetes-upgrade-20210813205735-393438", mac: "52:54:00:50:ef:93", ip: "192.168.39.75"}

	I0813 20:59:01.741051  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Reserved static IP address: 192.168.39.75

	I0813 20:59:01.741072  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Waiting for SSH to be available...

	I0813 20:59:01.741092  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Getting to WaitForSSH function...

	I0813 20:59:01.747891  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.748311  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:57:58 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:01.748341  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:01.748794  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH client type: external

	I0813 20:59:01.748825  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | Using SSH private key: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa (-rw-------)

	I0813 20:59:01.748867  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.75 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0813 20:59:01.748881  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | About to run SSH command:

	I0813 20:59:01.748893  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | exit 0

	I0813 20:59:04.251439  429844 containerd.go:546] Took 4.371086 seconds to copy over tarball

	I0813 20:59:04.251530  429844 ssh_runner.go:149] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0813 20:59:05.840828  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:06.340641  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:06.840589  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:07.340738  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:07.840607  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:08.340740  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:08.841423  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:09.341300  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:09.840616  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:10.340878  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:10.840590  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:11.340551  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:11.840776  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:12.341416  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:12.841143  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:13.340641  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:13.840699  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:14.340891  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:14.841272  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:15.340868  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:15.367894  429197 api_server.go:70] duration metric: took 12.541339791s to wait for apiserver process to appear ...

	I0813 20:59:15.367920  429197 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:59:15.367932  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:15.369463  429197 api_server.go:255] stopped: https://192.168.72.177:8443/healthz: Get "https://192.168.72.177:8443/healthz": dial tcp 192.168.72.177:8443: connect: connection refused

	I0813 20:59:14.967460  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | SSH cmd err, output: <nil>: 

	I0813 20:59:14.967832  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetConfigRaw

	I0813 20:59:14.968579  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:14.975946  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.976590  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:14.976617  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.977080  430322 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/kubernetes-upgrade-20210813205735-393438/config.json ...

	I0813 20:59:14.977327  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:14.977519  430322 machine.go:88] provisioning docker machine ...

	I0813 20:59:14.977551  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:14.977744  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:14.977932  430322 buildroot.go:166] provisioning hostname "kubernetes-upgrade-20210813205735-393438"

	I0813 20:59:14.977959  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:14.978140  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:14.984614  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.984978  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:14.985004  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:14.985249  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:14.985456  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:14.985630  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:14.985808  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:14.986008  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:14.986206  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:14.986228  430322 main.go:130] libmachine: About to run SSH command:

	sudo hostname kubernetes-upgrade-20210813205735-393438 && echo "kubernetes-upgrade-20210813205735-393438" | sudo tee /etc/hostname

	I0813 20:59:15.154609  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.154644  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.161683  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.162112  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.162145  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.162482  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:15.162710  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.162936  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.163108  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:15.163323  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:15.163532  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:15.163559  430322 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\skubernetes-upgrade-20210813205735-393438' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-20210813205735-393438/g' /etc/hosts;

				else 

					echo '127.0.1.1 kubernetes-upgrade-20210813205735-393438' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 20:59:15.322283  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 20:59:15.322316  430322 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikub

e/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 20:59:15.322360  430322 buildroot.go:174] setting up certificates

	I0813 20:59:15.322375  430322 provision.go:83] configureAuth start

	I0813 20:59:15.322388  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetMachineName

	I0813 20:59:15.322753  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:15.329092  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.329518  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.329541  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.330028  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.335895  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.336319  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.336343  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.336720  430322 provision.go:138] copyHostCerts

	I0813 20:59:15.336809  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 20:59:15.336821  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 20:59:15.336872  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1078 bytes)

	I0813 20:59:15.336988  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 20:59:15.336997  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 20:59:15.337026  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 20:59:15.337088  430322 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 20:59:15.337150  430322 exec_runner.go:190] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 20:59:15.337183  430322 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 20:59:15.337294  430322 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-20210813205735-393438 san=[192.168.39.75 192.168.39.75 localhost 127.0.0.1 minikube kubernetes-upgrade-20210813205735-393438]

	I0813 20:59:15.804742  430322 provision.go:172] copyRemoteCerts

	I0813 20:59:15.804803  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 20:59:15.804839  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:15.810630  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.811009  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:15.811045  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:15.811311  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:15.811513  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:15.811677  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:15.811829  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:15.907977  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0813 20:59:15.926182  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1289 bytes)

	I0813 20:59:15.969182  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 20:59:15.994398  430322 provision.go:86] duration metric: configureAuth took 672.012293ms

	I0813 20:59:15.994426  430322 buildroot.go:189] setting minikube options for container-runtime

	I0813 20:59:15.994619  430322 config.go:177] Loaded profile config "kubernetes-upgrade-20210813205735-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.22.0-rc.0

	I0813 20:59:15.994636  430322 machine.go:91] provisioned docker machine in 1.017093923s

	I0813 20:59:15.994647  430322 start.go:267] post-start starting for "kubernetes-upgrade-20210813205735-393438" (driver="kvm2")

	I0813 20:59:15.994656  430322 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 20:59:15.994706  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:15.998921  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 20:59:15.998955  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.005687  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.006139  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.006166  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.006764  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.006965  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.007139  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.007310  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:14.775039  429844 ssh_runner.go:189] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (10.523480791s)

	I0813 20:59:14.775063  429844 containerd.go:553] Took 10.523589 seconds t extract the tarball

	I0813 20:59:14.775075  429844 ssh_runner.go:100] rm: /preloaded.tar.lz4

	I0813 20:59:14.847701  429844 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:59:15.046932  429844 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:59:15.115651  429844 ssh_runner.go:149] Run: sudo systemctl stop -f crio

	I0813 20:59:15.156721  429844 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 20:59:15.176516  429844 docker.go:153] disabling docker service ...

	I0813 20:59:15.176575  429844 ssh_runner.go:149] Run: sudo systemctl stop -f docker.socket

	I0813 20:59:15.195373  429844 ssh_runner.go:149] Run: sudo systemctl stop -f docker.service

	I0813 20:59:15.208929  429844 ssh_runner.go:149] Run: sudo systemctl disable docker.socket

	I0813 20:59:15.423095  429844 ssh_runner.go:149] Run: sudo systemctl mask docker.service

	I0813 20:59:15.651161  429844 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service docker

	I0813 20:59:15.667410  429844 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 20:59:15.686989  429844 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "cm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwbHVnaW5zXQogIFtwbHVnaW5zLmNncm91cHNdCiAgICBub19wcm9tZXRoZXVzID0gZmFsc2UKICBbcGx1Z2lucy5jcmldCiAgICBzdHJlYW1fc2VydmVyX2FkZHJlc3MgPSAiIgogICAgc3RyZWFtX3NlcnZlcl9wb3J0ID0gIjEwMDEwIgogICAgZW5hYmxlX3NlbGludXggPSBmYWxzZQogICAgc2FuZGJveF9pbWFnZSA9ICJrOHMuZ2NyLmlvL3BhdXNlOjMuNC4xIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKCglbcGx1Z2lucy4iaW8uY

29udGFpbmVyZC5ncnBjLnYxLmNyaSJdCiAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkLnJ1bnRpbWVzXQogICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuY10KICAgICAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXMucnVuYy5vcHRpb25zXQogICAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSB0cnVlCgogICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmRdCiAgICAgIHNuYXBzaG90dGVyID0gIm92ZXJsYXlmcyIKICAgICAgW3BsdWdpbnMuY3JpLmNvbnRhaW5lcmQuZGVmYXVsdF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgIFtwbHVnaW5zLmNyaS5jb250YWluZXJkLnVudHJ1c3RlZF93b3JrbG9hZF9ydW50aW1lXQogICAgICAgIHJ1bnRpbWVfdHlwZSA9ICIiCiAgICAgICAgcnVudGltZV9lbmdpbmUgPSAiIgogICAgICAgIHJ1bnRpbWVfcm9vdCA9ICIiCiAgICBbcGx1Z2lucy5jcmkuY25pXQogICAgICBiaW5fZGlyID0gIi9vcHQvY25pL2JpbiIKICAgICAgY29uZl9kaXIgPSAiL2V0Yy9jbmkvbmV0LmQiC

iAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuY3JpLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy5jcmkucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy5kaWZmLXNlcnZpY2VdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy5zY2hlZHVsZXJdCiAgICBwYXVzZV90aHJlc2hvbGQgPSAwLjAyCiAgICBkZWxldGlvbl90aHJlc2hvbGQgPSAwCiAgICBtdXRhdGlvbl90aHJlc2hvbGQgPSAxMDAKICAgIHNjaGVkdWxlX2RlbGF5ID0gIjBzIgogICAgc3RhcnR1cF9kZWxheSA9ICIxMDBtcyIK" | base64 -d | sudo tee /etc/containerd/config.toml"

	I0813 20:59:15.707356  429844 ssh_runner.go:149] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0813 20:59:15.716851  429844 crio.go:128] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0813 20:59:15.716901  429844 ssh_runner.go:149] Run: sudo modprobe br_netfilter

	I0813 20:59:15.737623  429844 ssh_runner.go:149] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0813 20:59:15.746974  429844 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 20:59:15.934895  429844 ssh_runner.go:149] Run: sudo systemctl restart containerd

	I0813 20:59:16.002845  429844 start.go:392] Will wait 60s for socket path /run/containerd/containerd.sock

	I0813 20:59:16.002896  429844 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:59:16.010688  429844 retry.go:31] will retry after 1.104660288s: stat /run/containerd/containerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/run/containerd/containerd.sock': No such file or directory

	I0813 20:59:17.115625  429844 ssh_runner.go:149] Run: stat /run/containerd/containerd.sock

	I0813 20:59:17.122401  429844 start.go:413] Will wait 60s for crictl version

	I0813 20:59:17.122460  429844 ssh_runner.go:149] Run: sudo crictl version

	I0813 20:59:17.161733  429844 start.go:422] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  v1.4.9

	RuntimeApiVersion:  v1alpha2

	I0813 20:59:17.161805  429844 ssh_runner.go:149] Run: containerd --version

	I0813 20:59:17.195014  429844 ssh_runner.go:149] Run: containerd --version

	I0813 20:59:17.227710  429844 out.go:177] * Preparing Kubernetes v1.21.3 on containerd 1.4.9 ...

	I0813 20:59:17.227794  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) Calling .GetIP

	I0813 20:59:17.233294  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:59:17.233714  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ec:fb:29", ip: ""} in network mk-force-systemd-env-20210813205836-393438: {Iface:virbr5 ExpiryTime:2021-08-13 21:58:53 +0000 UTC Type:0 Mac:52:54:00:ec:fb:29 Iaid: IPaddr:192.168.83.204 Prefix:24 Hostname:force-systemd-env-20210813205836-393438 Clientid:01:52:54:00:ec:fb:29}

	I0813 20:59:17.233767  429844 main.go:130] libmachine: (force-systemd-env-20210813205836-393438) DBG | domain force-systemd-env-20210813205836-393438 has defined IP address 192.168.83.204 and MAC address 52:54:00:ec:fb:29 in network mk-force-systemd-env-20210813205836-393438

	I0813 20:59:17.233945  429844 ssh_runner.go:149] Run: grep 192.168.83.1	host.minikube.internal$ /etc/hosts

	I0813 20:59:17.238972  429844 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:59:17.252336  429844 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime containerd

	I0813 20:59:17.252395  429844 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:17.286326  429844 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:59:17.286348  429844 containerd.go:517] Images already preloaded, skipping extraction

	I0813 20:59:17.286402  429844 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:17.318852  429844 containerd.go:613] all images are preloaded for containerd runtime.

	I0813 20:59:17.318878  429844 cache_images.go:74] Images are preloaded, skipping loading

	I0813 20:59:17.318944  429844 ssh_runner.go:149] Run: sudo crictl info

	I0813 20:59:17.350917  429844 cni.go:93] Creating CNI manager for ""

	I0813 20:59:17.350945  429844 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:59:17.350958  429844 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 20:59:17.350973  429844 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.204 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:force-systemd-env-20210813205836-393438 NodeName:force-systemd-env-20210813205836-393438 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.204"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.83.204 CgroupD

river:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 20:59:17.351127  429844 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.83.204

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "force-systemd-env-20210813205836-393438"

	  kubeletExtraArgs:

	    node-ip: 192.168.83.204

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.83.204"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 20:59:17.351246  429844 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=force-systemd-env-20210813205836-393438 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.204 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 20:59:17.351312  429844 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 20:59:17.359902  429844 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 20:59:17.359971  429844 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 20:59:17.366944  429844 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (555 bytes)

	I0813 20:59:17.379424  429844 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 20:59:17.391585  429844 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2095 bytes)

	I0813 20:59:17.406745  429844 ssh_runner.go:149] Run: grep 192.168.83.204	control-plane.minikube.internal$ /etc/hosts

	I0813 20:59:17.411069  429844 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.204	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 20:59:17.422330  429844 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438 for IP: 192.168.83.204

	I0813 20:59:17.422387  429844 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 20:59:17.422411  429844 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 20:59:17.422464  429844 certs.go:297] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key

	I0813 20:59:17.422475  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt with IP's: []

	I0813 20:59:17.589717  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt ...

	I0813 20:59:17.589751  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.crt: {Name:mk6b638656acdae073d352761d68fbce2d483a2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.589968  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key ...

	I0813 20:59:17.589989  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/client.key: {Name:mk9ac2f2539726279887f5743a365e91b105c985 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.590095  429844 certs.go:297] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1

	I0813 20:59:17.590108  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 with IP's: [192.168.83.204 10.96.0.1 127.0.0.1 10.0.0.1]

	I0813 20:59:17.670870  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 ...

	I0813 20:59:17.670902  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1: {Name:mk74913ff00a65a919a90225ed0787c2cfa299a4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.671104  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1 ...

	I0813 20:59:17.671122  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1: {Name:mk4e832137b5b0e86e874baf2ff0ef565095edcf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.671224  429844 certs.go:308] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt.34cc45b1 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt

	I0813 20:59:17.671292  429844 certs.go:312] copying /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key.34cc45b1 -> /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key

	I0813 20:59:17.671342  429844 certs.go:297] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key

	I0813 20:59:17.671350  429844 crypto.go:69] Generating cert /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt with IP's: []

	I0813 20:59:17.811967  429844 crypto.go:157] Writing cert to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt ...

	I0813 20:59:17.811999  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt: {Name:mka2285c334ce140bfabe8b380f8ad699fb95705 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.812195  429844 crypto.go:165] Writing key to /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key ...

	I0813 20:59:17.812213  429844 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key: {Name:mkb6682fffa6b297b1d5d051bc98ddc5e21e1737 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:17.812326  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0813 20:59:17.812347  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0813 20:59:17.812362  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0813 20:59:17.812374  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0813 20:59:17.812388  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0813 20:59:17.812401  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0813 20:59:17.812413  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0813 20:59:17.812425  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0813 20:59:17.812864  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem (1338 bytes)

	W0813 20:59:17.812941  429844 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438_empty.pem, impossibly tiny 0 bytes

	I0813 20:59:17.812954  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1679 bytes)

	I0813 20:59:17.812992  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1078 bytes)

	I0813 20:59:17.813034  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 20:59:17.813070  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 20:59:17.813140  429844 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:59:17.813182  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem -> /usr/share/ca-certificates/393438.pem

	I0813 20:59:17.813203  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> /usr/share/ca-certificates/3934382.pem

	I0813 20:59:17.813220  429844 vm_assets.go:99] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:17.815185  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 20:59:17.835646  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 20:59:17.854490  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 20:59:17.870584  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/force-systemd-env-20210813205836-393438/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0813 20:59:17.888194  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 20:59:17.904940  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 20:59:17.923217  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 20:59:17.939714  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 20:59:17.956070  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/393438.pem --> /usr/share/ca-certificates/393438.pem (1338 bytes)

	I0813 20:59:17.973489  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /usr/share/ca-certificates/3934382.pem (1708 bytes)

	I0813 20:59:17.990533  429844 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 20:59:18.006640  429844 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 20:59:18.018556  429844 ssh_runner.go:149] Run: openssl version

	I0813 20:59:18.026398  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/393438.pem && ln -fs /usr/share/ca-certificates/393438.pem /etc/ssl/certs/393438.pem"

	I0813 20:59:18.036506  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.043248  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:20 /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.043295  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/393438.pem

	I0813 20:59:18.051624  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/393438.pem /etc/ssl/certs/51391683.0"

	I0813 20:59:18.060163  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3934382.pem && ln -fs /usr/share/ca-certificates/3934382.pem /etc/ssl/certs/3934382.pem"

	I0813 20:59:18.068077  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.073070  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:20 /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.073115  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3934382.pem

	I0813 20:59:18.079189  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3934382.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 20:59:18.086616  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 20:59:18.094245  429844 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.098831  429844 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:09 /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.098874  429844 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 20:59:18.104647  429844 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 20:59:18.112378  429844 kubeadm.go:390] StartCluster: {Name:force-systemd-env-20210813205836-393438 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/12032/minikube-v1.22.0-1628622362-12032.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio

n:v1.21.3 ClusterName:force-systemd-env-20210813205836-393438 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.83.204 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 20:59:18.112457  429844 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I0813 20:59:18.112500  429844 ssh_runner.go:149] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0813 20:59:18.152531  429844 cri.go:76] found id: ""

	I0813 20:59:18.152584  429844 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 20:59:18.160520  429844 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 20:59:18.167754  429844 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 20:59:18.174622  429844 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 20:59:18.174683  429844 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem"

	I0813 20:59:15.870106  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:19.916324  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0813 20:59:19.916355  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0813 20:59:20.369815  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:20.377224  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:20.377246  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:16.101618  430322 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 20:59:16.107180  430322 info.go:137] Remote host: Buildroot 2020.02.12

	I0813 20:59:16.107204  430322 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 20:59:16.107264  430322 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 20:59:16.107365  430322 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem -> 3934382.pem in /etc/ssl/certs

	I0813 20:59:16.107482  430322 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs

	I0813 20:59:16.116337  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/3934382.pem --> /etc/ssl/certs/3934382.pem (1708 bytes)

	I0813 20:59:16.137631  430322 start.go:270] post-start completed in 142.968259ms

	I0813 20:59:16.137673  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.137960  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.143893  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.144357  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.144393  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.144525  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.144729  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.144879  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.145013  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.145162  430322 main.go:130] libmachine: Using SSH client type: native

	I0813 20:59:16.145340  430322 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x802ea0] 0x802e60 <nil>  [] 0s} 192.168.39.75 22 <nil> <nil>}

	I0813 20:59:16.145356  430322 main.go:130] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0813 20:59:16.273390  430322 main.go:130] libmachine: SSH cmd err, output: <nil>: 1628888356.165572851

	I0813 20:59:16.273423  430322 fix.go:212] guest clock: 1628888356.165572851

	I0813 20:59:16.273435  430322 fix.go:225] Guest: 2021-08-13 20:59:16.165572851 +0000 UTC Remote: 2021-08-13 20:59:16.137936029 +0000 UTC m=+15.073653376 (delta=27.636822ms)

	I0813 20:59:16.273466  430322 fix.go:196] guest clock delta is within tolerance: 27.636822ms

	I0813 20:59:16.273484  430322 fix.go:57] fixHost completed within 15.007250096s

	I0813 20:59:16.273495  430322 start.go:80] releasing machines lock for "kubernetes-upgrade-20210813205735-393438", held for 15.007279625s

	I0813 20:59:16.273547  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.273864  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetIP

	I0813 20:59:16.280481  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.280887  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.280930  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.281057  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.281265  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.281833  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .DriverName

	I0813 20:59:16.282114  430322 ssh_runner.go:149] Run: systemctl --version

	I0813 20:59:16.282129  430322 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 20:59:16.282147  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.282183  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHHostname

	I0813 20:59:16.289563  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290185  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290473  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.290560  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.290775  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.290971  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.291085  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:50:ef:93", ip: ""} in network mk-kubernetes-upgrade-20210813205735-393438: {Iface:virbr1 ExpiryTime:2021-08-13 21:59:13 +0000 UTC Type:0 Mac:52:54:00:50:ef:93 Iaid: IPaddr:192.168.39.75 Prefix:24 Hostname:kubernetes-upgrade-20210813205735-393438 Clientid:01:52:54:00:50:ef:93}

	I0813 20:59:16.291206  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.291246  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) DBG | domain kubernetes-upgrade-20210813205735-393438 has defined IP address 192.168.39.75 and MAC address 52:54:00:50:ef:93 in network mk-kubernetes-upgrade-20210813205735-393438

	I0813 20:59:16.291408  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:16.291516  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHPort

	I0813 20:59:16.291696  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHKeyPath

	I0813 20:59:16.291840  430322 main.go:130] libmachine: (kubernetes-upgrade-20210813205735-393438) Calling .GetSSHUsername

	I0813 20:59:16.291971  430322 sshutil.go:53] new ssh client: &{IP:192.168.39.75 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/kubernetes-upgrade-20210813205735-393438/id_rsa Username:docker}

	I0813 20:59:16.377402  430322 preload.go:131] Checking if preload exists for k8s version v1.22.0-rc.0 and runtime containerd

	I0813 20:59:16.377543  430322 ssh_runner.go:149] Run: sudo crictl images --output json

	I0813 20:59:20.423651  430322 ssh_runner.go:189] Completed: sudo crictl images --output json: (4.04608471s)

	I0813 20:59:20.423837  430322 containerd.go:609] couldn't find preloaded image for "k8s.gcr.io/kube-apiserver:v1.22.0-rc.0". assuming images are not preloaded.

	I0813 20:59:20.423909  430322 ssh_runner.go:149] Run: which lz4

	I0813 20:59:20.428467  430322 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0813 20:59:20.433162  430322 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/preloaded.tar.lz4': No such file or directory

	I0813 20:59:20.433188  430322 ssh_runner.go:316] scp /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.22.0-rc.0-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (945588089 bytes)

	I0813 20:59:18.857423  429844 out.go:204]   - Generating certificates and keys ...

	I0813 20:59:21.576816  429844 out.go:204]   - Booting up control plane ...

	I0813 20:59:20.869652  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.055874  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:21.055917  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:21.370125  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.389753  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0813 20:59:21.389788  429197 api_server.go:101] status: https://192.168.72.177:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0813 20:59:21.874753  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:21.890465  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 200:

	ok

	I0813 20:59:21.902570  429197 api_server.go:139] control plane version: v1.20.0

	I0813 20:59:21.902598  429197 api_server.go:129] duration metric: took 6.534669952s to wait for apiserver health ...

	I0813 20:59:21.902612  429197 cni.go:93] Creating CNI manager for ""

	I0813 20:59:21.902621  429197 cni.go:163] "kvm2" driver + containerd runtime found, recommending bridge

	I0813 20:59:21.904775  429197 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0813 20:59:21.904840  429197 ssh_runner.go:149] Run: sudo mkdir -p /etc/cni/net.d

	I0813 20:59:21.918864  429197 ssh_runner.go:316] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0813 20:59:21.941920  429197 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 20:59:21.958653  429197 system_pods.go:59] 7 kube-system pods found

	I0813 20:59:21.960060  429197 system_pods.go:61] "coredns-74ff55c5b-ttqx2" [5fa519a7-e077-42ec-8813-20a70746db5d] Running

	I0813 20:59:21.960079  429197 system_pods.go:61] "etcd-running-upgrade-20210813205520-393438" [fe83f029-cb21-4cad-ac77-a85f49e7fce9] Running

	I0813 20:59:21.960087  429197 system_pods.go:61] "kube-apiserver-running-upgrade-20210813205520-393438" [c1e2f30a-1a50-43df-954b-a45b1270ecea] Running

	I0813 20:59:21.960094  429197 system_pods.go:61] "kube-controller-manager-running-upgrade-20210813205520-393438" [cff9407f-8f50-4fb7-a0ab-94fc0bd172a6] Running

	I0813 20:59:21.960099  429197 system_pods.go:61] "kube-proxy-n27fb" [bc2792f7-9b16-46cb-935f-f338306bfa30] Running

	I0813 20:59:21.960119  429197 system_pods.go:61] "kube-scheduler-running-upgrade-20210813205520-393438" [0a5ba635-fdf2-4704-8220-cdeef517411e] Running

	I0813 20:59:21.960131  429197 system_pods.go:61] "storage-provisioner" [11ab50e9-0e9e-4491-8ebc-67c7a715291f] Running

	I0813 20:59:21.960139  429197 system_pods.go:74] duration metric: took 18.193699ms to wait for pod list to return data ...

	I0813 20:59:21.960171  429197 node_conditions.go:102] verifying NodePressure condition ...

	I0813 20:59:21.965172  429197 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0813 20:59:21.965378  429197 node_conditions.go:123] node cpu capacity is 2

	I0813 20:59:21.965421  429197 node_conditions.go:105] duration metric: took 5.218443ms to run NodePressure ...

	I0813 20:59:21.965447  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 20:59:22.577680  429197 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 20:59:22.603858  429197 ops.go:34] apiserver oom_adj: -16

	I0813 20:59:22.603884  429197 kubeadm.go:604] restartCluster took 34.724172272s

	I0813 20:59:22.603907  429197 kubeadm.go:392] StartCluster complete in 34.836238371s

	I0813 20:59:22.603928  429197 settings.go:142] acquiring lock: {Name:mk2e042a75d7d4722d2a29030eed8e43c687ad8e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:22.604043  429197 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 20:59:22.605642  429197 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk8b97e3aadd41f736bf0e5000577319169228de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 20:59:22.606807  429197 kapi.go:59] client config for running-upgrade-20210813205520-393438: &rest.Config{Host:"https://192.168.72.177:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles

/running-upgrade-20210813205520-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:59:22.619466  429197 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "running-upgrade-20210813205520-393438" rescaled to 1

	I0813 20:59:22.619522  429197 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.72.177 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}

	I0813 20:59:22.621692  429197 out.go:177] * Verifying Kubernetes components...

	I0813 20:59:22.621764  429197 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 20:59:22.619684  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 20:59:22.619704  429197 addons.go:342] enableAddons start: toEnable=map[default-storageclass:true storage-provisioner:true], additional=[]

	I0813 20:59:22.621911  429197 addons.go:59] Setting storage-provisioner=true in profile "running-upgrade-20210813205520-393438"

	I0813 20:59:22.621929  429197 addons.go:135] Setting addon storage-provisioner=true in "running-upgrade-20210813205520-393438"

	W0813 20:59:22.621936  429197 addons.go:147] addon storage-provisioner should already be in state true

	I0813 20:59:22.621963  429197 host.go:66] Checking if "running-upgrade-20210813205520-393438" exists ...

	I0813 20:59:22.622493  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:22.622530  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:22.619917  429197 config.go:177] Loaded profile config "running-upgrade-20210813205520-393438": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I0813 20:59:22.622616  429197 addons.go:59] Setting default-storageclass=true in profile "running-upgrade-20210813205520-393438"

	I0813 20:59:22.622635  429197 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-20210813205520-393438"

	I0813 20:59:22.623179  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:22.623223  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:22.637873  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:44345

	I0813 20:59:22.638578  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:22.639220  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:59:22.639239  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:22.639898  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:22.640523  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:22.640570  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:22.652781  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:42783

	I0813 20:59:22.653292  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:22.653863  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:59:22.653887  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:22.654095  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:33127

	I0813 20:59:22.654278  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:22.654479  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetState

	I0813 20:59:22.654529  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:22.655752  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:59:22.655773  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:22.656189  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:22.656355  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetState

	I0813 20:59:22.659996  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:59:22.660189  429197 kapi.go:59] client config for running-upgrade-20210813205520-393438: &rest.Config{Host:"https://192.168.72.177:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/running-upgrade-20210813205520-393438/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles

/running-upgrade-20210813205520-393438/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x17e2d00), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0813 20:59:22.664553  429197 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 20:59:22.664693  429197 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:59:22.664710  429197 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 20:59:22.664731  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:59:22.671091  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:59:22.671647  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:59:22.671670  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:59:22.671848  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:59:22.672043  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:59:22.672281  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:59:22.672449  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:59:22.689765  429197 addons.go:135] Setting addon default-storageclass=true in "running-upgrade-20210813205520-393438"

	W0813 20:59:22.689792  429197 addons.go:147] addon default-storageclass should already be in state true

	I0813 20:59:22.689822  429197 host.go:66] Checking if "running-upgrade-20210813205520-393438" exists ...

	I0813 20:59:22.690282  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:22.690332  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:22.707262  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:38209

	I0813 20:59:22.707809  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:22.708384  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:59:22.708407  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:22.709099  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:22.709938  429197 main.go:130] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2

	I0813 20:59:22.709984  429197 main.go:130] libmachine: Launching plugin server for driver kvm2

	I0813 20:59:22.724751  429197 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40185

	I0813 20:59:22.725194  429197 main.go:130] libmachine: () Calling .GetVersion

	I0813 20:59:22.725797  429197 main.go:130] libmachine: Using API Version  1

	I0813 20:59:22.725825  429197 main.go:130] libmachine: () Calling .SetConfigRaw

	I0813 20:59:22.726262  429197 main.go:130] libmachine: () Calling .GetMachineName

	I0813 20:59:22.726435  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetState

	I0813 20:59:22.730833  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .DriverName

	I0813 20:59:22.734924  429197 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 20:59:22.734941  429197 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 20:59:22.734962  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHHostname

	I0813 20:59:22.742312  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:59:22.742835  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:51:ee:19", ip: ""} in network minikube-net: {Iface:virbr4 ExpiryTime:2021-08-13 21:56:44 +0000 UTC Type:0 Mac:52:54:00:51:ee:19 Iaid: IPaddr:192.168.72.177 Prefix:24 Hostname:running-upgrade-20210813205520-393438 Clientid:01:52:54:00:51:ee:19}

	I0813 20:59:22.742966  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | domain running-upgrade-20210813205520-393438 has defined IP address 192.168.72.177 and MAC address 52:54:00:51:ee:19 in network minikube-net

	I0813 20:59:22.743309  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHPort

	I0813 20:59:22.743505  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHKeyPath

	I0813 20:59:22.743687  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .GetSSHUsername

	I0813 20:59:22.743903  429197 sshutil.go:53] new ssh client: &{IP:192.168.72.177 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2-containerd-12230-389865-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/running-upgrade-20210813205520-393438/id_rsa Username:docker}

	I0813 20:59:22.826570  429197 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 20:59:22.886297  429197 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 20:59:23.210554  429197 api_server.go:50] waiting for apiserver process to appear ...

	I0813 20:59:23.210637  429197 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 20:59:23.211251  429197 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.72.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0813 20:59:24.374857  429197 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.548247452s)

	I0813 20:59:24.374906  429197 main.go:130] libmachine: Making call to close driver server

	I0813 20:59:24.374918  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .Close

	I0813 20:59:24.374928  429197 ssh_runner.go:189] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.488599374s)

	I0813 20:59:24.374961  429197 main.go:130] libmachine: Making call to close driver server

	I0813 20:59:24.374979  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .Close

	I0813 20:59:24.375017  429197 ssh_runner.go:189] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.164366671s)

	I0813 20:59:24.375031  429197 api_server.go:70] duration metric: took 1.75547246s to wait for apiserver process to appear ...

	I0813 20:59:24.375044  429197 api_server.go:86] waiting for apiserver healthz status ...

	I0813 20:59:24.375054  429197 api_server.go:239] Checking apiserver healthz at https://192.168.72.177:8443/healthz ...

	I0813 20:59:24.375210  429197 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:59:24.375232  429197 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:59:24.375243  429197 main.go:130] libmachine: Making call to close driver server

	I0813 20:59:24.375252  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .Close

	I0813 20:59:24.375406  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:59:24.375422  429197 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:59:24.375434  429197 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:59:24.375442  429197 main.go:130] libmachine: Making call to close driver server

	I0813 20:59:24.375451  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .Close

	I0813 20:59:24.375526  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:59:24.375561  429197 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:59:24.375568  429197 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:59:24.375724  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) DBG | Closing plugin on server side

	I0813 20:59:24.375812  429197 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:59:24.375851  429197 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:59:24.375869  429197 main.go:130] libmachine: Making call to close driver server

	I0813 20:59:24.375891  429197 main.go:130] libmachine: (running-upgrade-20210813205520-393438) Calling .Close

	I0813 20:59:24.376089  429197 main.go:130] libmachine: Successfully made call to close driver server

	I0813 20:59:24.376105  429197 main.go:130] libmachine: Making call to close connection to plugin binary

	I0813 20:59:24.378279  429197 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 20:59:24.378301  429197 addons.go:344] enableAddons completed in 1.758604286s

	I0813 20:59:24.392763  429197 api_server.go:265] https://192.168.72.177:8443/healthz returned 200:

	ok

	I0813 20:59:24.393708  429197 api_server.go:139] control plane version: v1.20.0

	I0813 20:59:24.393728  429197 api_server.go:129] duration metric: took 18.6779ms to wait for apiserver health ...

	I0813 20:59:24.393738  429197 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 20:59:24.404645  429197 system_pods.go:59] 7 kube-system pods found

	I0813 20:59:24.404673  429197 system_pods.go:61] "coredns-74ff55c5b-ttqx2" [5fa519a7-e077-42ec-8813-20a70746db5d] Running

	I0813 20:59:24.404681  429197 system_pods.go:61] "etcd-running-upgrade-20210813205520-393438" [fe83f029-cb21-4cad-ac77-a85f49e7fce9] Running

	I0813 20:59:24.404687  429197 system_pods.go:61] "kube-apiserver-running-upgrade-20210813205520-393438" [c1e2f30a-1a50-43df-954b-a45b1270ecea] Running

	I0813 20:59:24.404700  429197 system_pods.go:61] "kube-controller-manager-running-upgrade-20210813205520-393438" [cff9407f-8f50-4fb7-a0ab-94fc0bd172a6] Running

	I0813 20:59:24.404705  429197 system_pods.go:61] "kube-proxy-n27fb" [bc2792f7-9b16-46cb-935f-f338306bfa30] Running

	I0813 20:59:24.404711  429197 system_pods.go:61] "kube-scheduler-running-upgrade-20210813205520-393438" [0a5ba635-fdf2-4704-8220-cdeef517411e] Running

	I0813 20:59:24.404716  429197 system_pods.go:61] "storage-provisioner" [11ab50e9-0e9e-4491-8ebc-67c7a715291f] Running

	I0813 20:59:24.404723  429197 system_pods.go:74] duration metric: took 10.979983ms to wait for pod list to return data ...

	I0813 20:59:24.404737  429197 kubeadm.go:547] duration metric: took 1.785179858s to wait for : map[apiserver:true system_pods:true] ...

	I0813 20:59:24.404761  429197 node_conditions.go:102] verifying NodePressure condition ...

	I0813 20:59:24.411084  429197 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0813 20:59:24.411108  429197 node_conditions.go:123] node cpu capacity is 2

	I0813 20:59:24.411121  429197 node_conditions.go:105] duration metric: took 6.354065ms to run NodePressure ...

	I0813 20:59:24.411132  429197 start.go:231] waiting for startup goroutines ...

	I0813 20:59:24.488430  429197 start.go:462] kubectl: 1.20.5, cluster: 1.20.0 (minor skew: 0)

	I0813 20:59:24.490754  429197 out.go:177] * Done! kubectl is now configured to use "running-upgrade-20210813205520-393438" cluster and "default" namespace by default

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	33fae69af6bcf       6e38f40d628db       59 seconds ago       Exited              storage-provisioner       0                   76aee79f917be

	b6372d9d76486       296a6d5035e2d       About a minute ago   Running             coredns                   1                   cfc4c8785e479

	afabb5f130410       0369cf4303ffd       About a minute ago   Running             etcd                      1                   3f41ec729ef71

	57f3f32f280d8       bc2bb319a7038       About a minute ago   Running             kube-controller-manager   1                   ce1823a3db17a

	1053b5b4ba3ab       3d174f00aa39e       About a minute ago   Running             kube-apiserver            1                   a655f217cf1c5

	0d1a942c8b8c2       adb2816ea823a       About a minute ago   Running             kube-proxy                1                   47e050012dbca

	1d84b053549cf       6be0dc1302e30       About a minute ago   Running             kube-scheduler            1                   53f314c6cf963

	1bba0d6deb033       adb2816ea823a       2 minutes ago        Exited              kube-proxy                0                   3f6f239c2851f

	63c0cc1fc4c0c       296a6d5035e2d       2 minutes ago        Exited              coredns                   0                   b1f1f31f28005

	698bbea7ce6e9       6be0dc1302e30       2 minutes ago        Exited              kube-scheduler            0                   5a66336a35add

	df02c38abac90       0369cf4303ffd       2 minutes ago        Exited              etcd                      0                   4cf745987f602

	68bad43283064       bc2bb319a7038       2 minutes ago        Exited              kube-controller-manager   0                   5340b4aa5ca39

	11c2753c9a8a7       3d174f00aa39e       2 minutes ago        Exited              kube-apiserver            0                   304b611d719ea

	* 

	* ==> containerd <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:59:26 UTC. --

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.078142311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:etcd-pause-20210813205520-393438,Uid:86a000e5c08d32d80b2fd4e89cd34dd1,Namespace:kube-system,Attempt:1,} returns sandbox id \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.145266794Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for container &ContainerMetadata{Name:etcd,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.321521915Z" level=info msg="StartContainer for \"1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c\" returns successfully"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.349622186Z" level=info msg="CreateContainer within sandbox \"3f41ec729ef71933ec60f8fb632875419302e95acc029a319006f332461cf7cf\" for &ContainerMetadata{Name:etcd,Attempt:1,} returns container id \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.353268082Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.376810925Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-558bd4d5db-jzmnb,Uid:ea00ae4c-f4d9-414c-8762-6314a96c8a06,Namespace:kube-system,Attempt:1,} returns sandbox id \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.451595226Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for container &ContainerMetadata{Name:coredns,Attempt:1,}"

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.633919582Z" level=info msg="CreateContainer within sandbox \"cfc4c8785e479503ceb2167b74d4f0b99b2deda88e0bc8dd63814c860e14a682\" for &ContainerMetadata{Name:coredns,Attempt:1,} returns container id \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.635324605Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\""

	Aug 13 20:58:11 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:11.770314446Z" level=info msg="StartContainer for \"57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.016041628Z" level=info msg="StartContainer for \"afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5\" returns successfully"

	Aug 13 20:58:12 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:12.229109322Z" level=info msg="StartContainer for \"b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d\" returns successfully"

	Aug 13 20:58:15 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:15.472167045Z" level=info msg="StartContainer for \"0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5\" returns successfully"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.856093567Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,}"

	Aug 13 20:58:25 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:25.901091488Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a pid=4886

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.481756294Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:99920d7c-bb8d-4c65-bf44-b56f23a40e53,Namespace:kube-system,Attempt:0,} returns sandbox id \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.492027606Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.607213854Z" level=info msg="CreateContainer within sandbox \"76aee79f917be71c3e014a4ade7ae7ab1f11efd5f870006e1575f690175c605a\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.614295374Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:26 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:26.876068804Z" level=info msg="StartContainer for \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\" returns successfully"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.156236073Z" level=info msg="Finish piping stderr of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.158102368Z" level=info msg="Finish piping stdout of container \"33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81\""

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.159567062Z" level=info msg="TaskExit event &TaskExit{ContainerID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,ID:33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81,Pid:4945,ExitStatus:255,ExitedAt:2021-08-13 20:58:41.157732657 +0000 UTC,XXX_unrecognized:[],}"

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217770540Z" level=info msg="shim disconnected" id=33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81

	Aug 13 20:58:41 pause-20210813205520-393438 containerd[3753]: time="2021-08-13T20:58:41.217941244Z" level=error msg="copy shim log" error="read /proc/self/fd/98: file already closed"

	* 

	* ==> coredns [63c0cc1fc4c0cb78fac8fe29e80eed8b43fa6762ce189d85564911aed6114ba0] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I0813 20:57:49.980199       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.978) (total time: 30001ms):

	Trace[2019727887]: [30.001847928s] [30.001847928s] END

	E0813 20:57:49.980279       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.980655       1 trace.go:205] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[939984059]: [30.00501838s] [30.00501838s] END

	E0813 20:57:49.980691       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:57:49.981307       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:57:19.975) (total time: 30005ms):

	Trace[911902081]: [30.005916603s] [30.005916603s] END

	E0813 20:57:49.981521       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [b6372d9d7648658f7077421ada6d80fd2a27141edbbd6ee51d78346ef736205d] <==

	* E0813 20:58:20.310855       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:serviceaccount:kube-system:coredns" cannot list resource "services" in API group "" at the cluster scope

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 6b95276539722f40f4545af91578505c

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* Name:               pause-20210813205520-393438

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=pause-20210813205520-393438

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=pause-20210813205520-393438

	                    minikube.k8s.io/updated_at=2021_08_13T20_57_02_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:56:57 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  pause-20210813205520-393438

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:58:20 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:56:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:57:09 +0000   Fri, 13 Aug 2021 20:57:09 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.61.151

	  Hostname:    pause-20210813205520-393438

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2033044Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2033044Ki

	  pods:               110

	System Info:

	  Machine ID:                 77eb9b5f6d424569bb9c035580bd499b

	  System UUID:                77eb9b5f-6d42-4569-bb9c-035580bd499b

	  Boot ID:                    f7c4e7cb-b855-4691-ba67-6445018f8c6d

	  Kernel Version:             4.19.182

	  OS Image:                   Buildroot 2020.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  containerd://1.4.9

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-558bd4d5db-jzmnb                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     2m10s

	  kube-system                 etcd-pause-20210813205520-393438                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (5%!)(MISSING)       0 (0%!)(MISSING)         2m18s

	  kube-system                 kube-apiserver-pause-20210813205520-393438             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m18s

	  kube-system                 kube-controller-manager-pause-20210813205520-393438    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m18s

	  kube-system                 kube-proxy-mlf5c                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m10s

	  kube-system                 kube-scheduler-pause-20210813205520-393438             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m24s

	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         61s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (8%!)(MISSING)  170Mi (8%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasSufficientMemory  2m44s (x8 over 2m45s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m44s (x8 over 2m45s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m44s (x7 over 2m45s)  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m18s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m18s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m18s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m18s                  kubelet     Node pause-20210813205520-393438 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m18s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                2m17s                  kubelet     Node pause-20210813205520-393438 status is now: NodeReady

	  Normal  Starting                 2m6s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 63s                    kube-proxy  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [  +0.000017] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.863604] systemd-fstab-generator[1160]: Ignoring "noauto" for root device

	[  +0.032050] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +0.917916] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=1722 comm=systemd-network

	[  +2.669268] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.

	[  +0.335717] vboxguest: loading out-of-tree module taints kernel.

	[  +0.008488] vboxguest: PCI device not found, probably running on physical hardware.

	[Aug13 20:56] systemd-fstab-generator[2101]: Ignoring "noauto" for root device

	[  +0.927578] systemd-fstab-generator[2132]: Ignoring "noauto" for root device

	[  +0.140064] systemd-fstab-generator[2146]: Ignoring "noauto" for root device

	[  +0.195734] systemd-fstab-generator[2179]: Ignoring "noauto" for root device

	[  +8.321149] systemd-fstab-generator[2386]: Ignoring "noauto" for root device

	[Aug13 20:57] systemd-fstab-generator[2823]: Ignoring "noauto" for root device

	[ +16.072552] kauditd_printk_skb: 38 callbacks suppressed

	[ +34.372009] kauditd_printk_skb: 116 callbacks suppressed

	[  +3.958113] NFSD: Unable to end grace period: -110

	[Aug13 20:58] systemd-fstab-generator[3706]: Ignoring "noauto" for root device

	[  +0.206181] systemd-fstab-generator[3719]: Ignoring "noauto" for root device

	[  +0.261980] systemd-fstab-generator[3744]: Ignoring "noauto" for root device

	[ +19.584639] kauditd_printk_skb: 41 callbacks suppressed

	[  +5.482860] systemd-fstab-generator[4981]: Ignoring "noauto" for root device

	[  +0.846439] systemd-fstab-generator[5035]: Ignoring "noauto" for root device

	[Aug13 20:59] systemd-fstab-generator[5622]: Ignoring "noauto" for root device

	[  +0.795991] systemd-fstab-generator[5652]: Ignoring "noauto" for root device

	* 

	* ==> etcd [afabb5f13041070a9ab9a114ca1f565264d2fc673c1daf47d64669af0aa8c3e5] <==

	* 2021-08-13 20:58:16.461857 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true " with result "range_response_count:0 size:5" took too long (198.960862ms) to execute

	2021-08-13 20:58:16.462013 W | etcdserver: read-only range request "key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" limit:10000 " with result "range_response_count:0 size:5" took too long (199.025411ms) to execute

	2021-08-13 20:58:16.462116 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (190.42222ms) to execute

	2021-08-13 20:58:16.462337 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (179.184455ms) to execute

	2021-08-13 20:58:16.462702 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (172.711746ms) to execute

	2021-08-13 20:58:16.462925 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (170.528555ms) to execute

	2021-08-13 20:58:16.463221 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (158.293847ms) to execute

	2021-08-13 20:58:16.463747 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" limit:10000 " with result "range_response_count:0 size:5" took too long (158.490371ms) to execute

	2021-08-13 20:58:16.464124 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (152.464331ms) to execute

	2021-08-13 20:58:16.477058 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (151.343452ms) to execute

	2021-08-13 20:58:16.478005 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" count_only:true " with result "range_response_count:0 size:5" took too long (142.028022ms) to execute

	2021-08-13 20:58:16.478939 W | etcdserver: read-only range request "key:\"/registry/podsecuritypolicy/\" range_end:\"/registry/podsecuritypolicy0\" limit:10000 " with result "range_response_count:0 size:5" took too long (142.259692ms) to execute

	2021-08-13 20:58:16.479721 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" limit:10000 " with result "range_response_count:0 size:5" took too long (129.328346ms) to execute

	2021-08-13 20:58:16.479967 W | etcdserver: read-only range request "key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true " with result "range_response_count:0 size:5" took too long (126.882803ms) to execute

	2021-08-13 20:58:16.480303 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" limit:10000 " with result "range_response_count:11 size:5977" took too long (116.866258ms) to execute

	2021-08-13 20:58:16.480852 W | etcdserver: read-only range request "key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true " with result "range_response_count:0 size:7" took too long (116.970061ms) to execute

	2021-08-13 20:58:23.354247 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/cluster-admin\" " with result "range_response_count:1 size:718" took too long (1.914180768s) to execute

	2021-08-13 20:58:23.356685 W | etcdserver: request "header:<ID:14244176716868856811 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" mod_revision:0 > success:<request_put:<key:\"/registry/events/kube-system/kube-apiserver-pause-20210813205520-393438.169af9452389bd61\" value_size:717 lease:5020804680014080881 >> failure:<>>" with result "size:16" took too long (1.23562281s) to execute

	2021-08-13 20:58:23.370142 W | wal: sync duration of 1.250273887s, expected less than 1s

	2021-08-13 20:58:23.370676 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.152835664s) to execute

	2021-08-13 20:58:23.371565 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.728436243s) to execute

	2021-08-13 20:58:23.371769 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.847351028s) to execute

	2021-08-13 20:58:23.378962 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-558bd4d5db-jzmnb\" " with result "range_response_count:1 size:4862" took too long (671.753147ms) to execute

	2021-08-13 20:58:24.705568 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:1 size:4394" took too long (221.501911ms) to execute

	2021-08-13 20:58:26.341296 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [df02c38abac90e1bfb1eaa8433ba9faac330d654e786d0c41901507b55d0c418] <==

	* 2021-08-13 20:56:51.867973 I | embed: serving client requests on 192.168.61.151:2379

	2021-08-13 20:56:51.875825 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:57:01.271062 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpointslicemirroring-controller\" " with result "range_response_count:0 size:5" took too long (480.2351ms) to execute

	2021-08-13 20:57:01.272131 W | etcdserver: read-only range request "key:\"/registry/minions/pause-20210813205520-393438\" " with result "range_response_count:1 size:3758" took too long (875.676682ms) to execute

	2021-08-13 20:57:01.273551 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f12dc\" " with result "range_response_count:1 size:735" took too long (792.283833ms) to execute

	2021-08-13 20:57:02.171621 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (872.818648ms) to execute

	2021-08-13 20:57:02.172160 W | etcdserver: request "header:<ID:14244176716848216677 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:222 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3993 >> failure:<request_range:<key:\"/registry/minions/pause-20210813205520-393438\" > >>" with result "size:16" took too long (128.660032ms) to execute

	2021-08-13 20:57:02.172330 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:351" took too long (871.615956ms) to execute

	2021-08-13 20:57:02.172733 W | etcdserver: read-only range request "key:\"/registry/events/default/pause-20210813205520-393438.169af930771f2f58\" " with result "range_response_count:1 size:733" took too long (859.92991ms) to execute

	2021-08-13 20:57:02.172849 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (853.236151ms) to execute

	2021-08-13 20:57:09.290631 W | etcdserver: request "header:<ID:14244176716848216792 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/pause-20210813205520-393438\" mod_revision:0 > success:<request_put:<key:\"/registry/minions/pause-20210813205520-393438\" value_size:3277 >> failure:<>>" with result "size:5" took too long (472.704737ms) to execute

	2021-08-13 20:57:09.291659 W | etcdserver: read-only range request "key:\"/registry/leases/kube-node-lease/pause-20210813205520-393438\" " with result "range_response_count:0 size:5" took too long (897.879132ms) to execute

	2021-08-13 20:57:09.298807 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-pause-20210813205520-393438\" " with result "range_response_count:1 size:4986" took too long (528.421007ms) to execute

	2021-08-13 20:57:09.299124 W | etcdserver: read-only range request "key:\"/registry/csinodes/pause-20210813205520-393438\" " with result "range_response_count:1 size:656" took too long (894.254864ms) to execute

	2021-08-13 20:57:13.314052 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" " with result "range_response_count:1 size:210" took too long (127.466898ms) to execute

	2021-08-13 20:57:13.314663 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (132.387511ms) to execute

	2021-08-13 20:57:16.343764 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:20.988739 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:30.989151 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:39.442816 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:422" took too long (120.094417ms) to execute

	2021-08-13 20:57:40.988900 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:57:50.989064 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:58:00.244154 W | etcdserver: request "header:<ID:14244176716848217456 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.61.151\" mod_revision:483 > success:<request_put:<key:\"/registry/masterleases/192.168.61.151\" value_size:69 lease:5020804679993441646 >> failure:<request_range:<key:\"/registry/masterleases/192.168.61.151\" > >>" with result "size:16" took too long (162.220853ms) to execute

	2021-08-13 20:58:00.245134 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (881.389444ms) to execute

	2021-08-13 20:58:00.989778 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> kernel <==

	*  20:59:26 up 3 min,  0 users,  load average: 0.98, 0.82, 0.35

	Linux pause-20210813205520-393438 4.19.182 #1 SMP Tue Aug 10 19:49:40 UTC 2021 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2020.02.12"

	* 

	* ==> kube-apiserver [1053b5b4ba3abe2d9116c62fc9d2a19e3df3b96688b25fed71f028b7fceffc2c] <==

	* Trace[553017594]: ---"About to write a response" 1919ms (20:58:00.358)

	Trace[553017594]: [1.920866407s] [1.920866407s] END

	I0813 20:58:23.381663       1 trace.go:205] Trace[1143050190]: "Get" url:/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-jzmnb,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:58:22.699) (total time: 682ms):

	Trace[1143050190]: ---"About to write a response" 681ms (20:58:00.380)

	Trace[1143050190]: [682.310081ms] [682.310081ms] END

	I0813 20:58:25.230359       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 20:58:25.281700       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 20:58:25.373725       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0813 20:58:25.413105       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:58:25.560667       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io

	I0813 20:59:15.369992       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:59:15.370169       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:59:15.370213       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	E0813 20:59:15.548831       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E0813 20:59:15.551721       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:15.551910       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:15.553384       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0813 20:59:16.253189       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled

	E0813 20:59:16.253342       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:16.254420       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:16.258368       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0813 20:59:16.261299       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0813 20:59:16.262291       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0813 20:59:16.288769       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I0813 20:59:16.754327       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	* 

	* ==> kube-apiserver [11c2753c9a8a79ebfb2fe156a698be51aed9e9d6ac5dfc0af27d0a4822c7d016] <==

	* I0813 20:57:09.309542       1 trace.go:205] Trace[2046907584]: "Create" url:/api/v1/nodes,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.501) (total time: 806ms):

	Trace[2046907584]: [806.482297ms] [806.482297ms] END

	I0813 20:57:09.310802       1 trace.go:205] Trace[146959614]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.771) (total time: 538ms):

	Trace[146959614]: ---"Object stored in database" 538ms (20:57:00.310)

	Trace[146959614]: [538.954794ms] [538.954794ms] END

	I0813 20:57:09.311138       1 trace.go:205] Trace[1128950750]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-pause-20210813205520-393438,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1128950750]: ---"About to write a response" 537ms (20:57:00.307)

	Trace[1128950750]: [541.267103ms] [541.267103ms] END

	I0813 20:57:09.311248       1 trace.go:205] Trace[1268223707]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 541ms):

	Trace[1268223707]: ---"Object stored in database" 540ms (20:57:00.310)

	Trace[1268223707]: [541.971563ms] [541.971563ms] END

	I0813 20:57:09.311433       1 trace.go:205] Trace[1977445463]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.772) (total time: 538ms):

	Trace[1977445463]: ---"Object stored in database" 537ms (20:57:00.310)

	Trace[1977445463]: [538.348208ms] [538.348208ms] END

	I0813 20:57:09.321803       1 trace.go:205] Trace[494614999]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.21.3 (linux/amd64) kubernetes/ca643a4,client:192.168.61.151,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (13-Aug-2021 20:57:08.769) (total time: 552ms):

	Trace[494614999]: [552.453895ms] [552.453895ms] END

	I0813 20:57:09.345220       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:57:16.259955       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	I0813 20:57:16.380865       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0813 20:57:37.272234       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:57:37.272418       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:57:37.272507       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:58:00.246413       1 trace.go:205] Trace[1997979141]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (13-Aug-2021 20:57:59.258) (total time: 987ms):

	Trace[1997979141]: ---"Transaction committed" 984ms (20:58:00.246)

	Trace[1997979141]: [987.521712ms] [987.521712ms] END

	* 

	* ==> kube-controller-manager [57f3f32f280d8a4cf60a8d8a37811ee7e7b9d9a126e4b37ae17516cb3b3a7849] <==

	* I0813 20:59:16.709660       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:59:16.712193       1 shared_informer.go:247] Caches are synced for GC 

	I0813 20:59:16.722572       1 shared_informer.go:247] Caches are synced for node 

	I0813 20:59:16.722685       1 range_allocator.go:172] Starting range CIDR allocator

	I0813 20:59:16.722692       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I0813 20:59:16.722698       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I0813 20:59:16.728359       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:59:16.729318       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:59:16.729562       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	I0813 20:59:16.729905       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:59:16.731175       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	W0813 20:59:16.731760       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:59:16.732194       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:59:16.732423       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:59:16.732906       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 

	I0813 20:59:16.747287       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:59:16.761010       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:59:16.769847       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:59:16.772854       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:59:16.793140       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:59:16.811782       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:59:16.811797       1 disruption.go:371] Sending events to api server.

	I0813 20:59:17.205296       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:59:17.277302       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:59:17.277855       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	* 

	* ==> kube-controller-manager [68bad432830642a2624a04015efd233270944ea918f0f82217367834481cc3a8] <==

	* I0813 20:57:15.593972       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:57:15.593991       1 disruption.go:371] Sending events to api server.

	I0813 20:57:15.596695       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:57:15.636700       1 shared_informer.go:247] Caches are synced for service account 

	I0813 20:57:15.652896       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:57:15.701400       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:57:15.701628       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:57:15.701702       1 node_lifecycle_controller.go:1013] Missing timestamp for Node pause-20210813205520-393438. Assuming now as a timestamp.

	I0813 20:57:15.701748       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:57:15.701825       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:57:15.702024       1 event.go:291] "Event occurred" object="pause-20210813205520-393438" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node pause-20210813205520-393438 event: Registered Node pause-20210813205520-393438 in Controller"

	I0813 20:57:15.735577       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0813 20:57:15.751667       1 shared_informer.go:247] Caches are synced for stateful set 

	I0813 20:57:15.767285       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:15.796364       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:57:15.847876       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:57:16.199991       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.200121       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:57:16.224599       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:57:16.277997       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:57:16.457337       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-mlf5c"

	I0813 20:57:16.545672       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-fhxw7"

	I0813 20:57:16.596799       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-jzmnb"

	I0813 20:57:16.804186       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:57:16.819742       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-fhxw7"

	* 

	* ==> kube-proxy [0d1a942c8b8c2548b54ccff6ad310e0bd108d6f335c4e7af29db42dea2d714c5] <==

	* E0813 20:58:20.334846       1 node.go:161] Failed to retrieve node info: nodes "pause-20210813205520-393438" is forbidden: User "system:serviceaccount:kube-system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope

	I0813 20:58:21.364522       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:58:21.365223       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:58:21.366125       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:58:23.461362       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:58:23.462248       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:58:23.465333       1 server_others.go:212] Using iptables Proxier.

	I0813 20:58:23.483125       1 server.go:643] Version: v1.21.3

	I0813 20:58:23.488959       1 config.go:315] Starting service config controller

	I0813 20:58:23.490323       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:58:23.490593       1 config.go:224] Starting endpoint slice config controller

	I0813 20:58:23.490606       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:58:23.512424       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:58:23.514744       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:58:23.591163       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:58:23.593313       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [1bba0d6deb03392a9c2a729aa9c03a18c3e1586cd458a1f081392f4b04d0ae62] <==

	* I0813 20:57:20.123665       1 node.go:172] Successfully retrieved node IP: 192.168.61.151

	I0813 20:57:20.123841       1 server_others.go:140] Detected node IP 192.168.61.151

	W0813 20:57:20.123909       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	W0813 20:57:20.180054       1 server_others.go:197] No iptables support for IPv6: exit status 3

	I0813 20:57:20.180158       1 server_others.go:208] kube-proxy running in single-stack IPv4 mode

	I0813 20:57:20.180173       1 server_others.go:212] Using iptables Proxier.

	I0813 20:57:20.181825       1 server.go:643] Version: v1.21.3

	I0813 20:57:20.184367       1 config.go:315] Starting service config controller

	I0813 20:57:20.184561       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:57:20.184600       1 config.go:224] Starting endpoint slice config controller

	I0813 20:57:20.184604       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:57:20.203222       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:57:20.207174       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:57:20.285130       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:57:20.285144       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [1d84b053549cf5e14f9013790cc45e59901f21453bab775d7ab0f7fdccc7958c] <==

	* I0813 20:58:11.830530       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:58:20.220887       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:58:20.224373       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:58:20.224624       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:58:20.224640       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:58:20.341243       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:58:20.343223       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.343608       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:58:20.347257       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:58:20.444874       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	W0813 20:59:05.413646       1 reflector.go:436] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: watch of *v1.ConfigMap ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831376       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PersistentVolumeClaim ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831398       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Node ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831633       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Pod ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831662       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831677       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.CSIDriver ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831719       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.CSIStorageCapacity ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831730       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.StorageClass ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831767       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.CSINode ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831776       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.ReplicationController ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831804       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.ReplicaSet ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831815       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.StatefulSet ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831834       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PodDisruptionBudget ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W0813 20:59:12.831859       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.PersistentVolume ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	* 

	* ==> kube-scheduler [698bbea7ce6e9ce2ff33d763621c6d0ae027c7205d816ea431cafc6e045b6889] <==

	* I0813 20:56:57.340096       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:56:57.373873       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:57.375600       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:57.398047       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:57.406392       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:56:57.418940       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.424521       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:57.426539       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:56:57.426578       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:56:57.428616       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428765       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:56:57.428811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:57.428854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:57.428897       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:56:58.261670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:56:58.311937       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:56:58.405804       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.463800       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:56:58.585826       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.615525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:56:58.626736       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:56:58.669986       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:56:58.791820       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0813 20:57:01.440271       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:55:52 UTC, end at Fri 2021-08-13 20:59:27 UTC. --

	Aug 13 20:59:16 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:16.442997    5630 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.121813    5630 server.go:660] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.123739    5630 container_manager_linux.go:278] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124150    5630 container_manager_linux.go:283] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124413    5630 topology_manager.go:120] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124800    5630 container_manager_linux.go:314] "Initializing Topology Manager" policy="none" scope="container"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.124979    5630 container_manager_linux.go:319] "Creating device plugin manager" devicePluginEnabled=true

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125347    5630 remote_runtime.go:62] parsed scheme: ""

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125615    5630 remote_runtime.go:62] scheme "" not registered, fallback to default scheme

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.125862    5630 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126021    5630 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126351    5630 remote_image.go:50] parsed scheme: ""

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126598    5630 remote_image.go:50] scheme "" not registered, fallback to default scheme

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126791    5630 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{/run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.126948    5630 clientconn.go:948] ClientConn switching balancer to "pick_first"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127298    5630 kubelet.go:404] "Attempting to sync node with API server"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127591    5630 kubelet.go:272] "Adding static pod path" path="/etc/kubernetes/manifests"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.127844    5630 kubelet.go:283] "Adding apiserver pod source"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.128310    5630 apiserver.go:42] "Waiting for node sync before watching apiserver pods"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.153644    5630 kuberuntime_manager.go:222] "Container runtime initialized" containerRuntime="containerd" version="v1.4.9" apiVersion="v1alpha2"

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: E0813 20:59:21.470849    5630 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated.

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]:         For verbose messaging see aws.Config.CredentialsChainVerboseErrors

	Aug 13 20:59:21 pause-20210813205520-393438 kubelet[5630]: I0813 20:59:21.489062    5630 server.go:1190] "Started kubelet"

	Aug 13 20:59:21 pause-20210813205520-393438 systemd[1]: kubelet.service: Succeeded.

	Aug 13 20:59:21 pause-20210813205520-393438 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* 

	* ==> storage-provisioner [33fae69af6bcf7f1d0806b0e88905d0299d36a6e1bdbe6a0842fdfddca291e81] <==

	* 	/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:880 +0x4af

	goroutine 90 [sync.Cond.Wait]:

	sync.runtime_notifyListWait(0xc000328290, 0xc000000003)

		/usr/local/go/src/runtime/sema.go:513 +0xf8

	sync.(*Cond).Wait(0xc000328280)

		/usr/local/go/src/sync/cond.go:56 +0x99

	k8s.io/client-go/util/workqueue.(*Type).Get(0xc0003f0480, 0x0, 0x0, 0x0)

		/Users/medya/go/pkg/mod/k8s.io/client-go@v0.20.5/util/workqueue/queue.go:145 +0x89

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).processNextVolumeWorkItem(0xc0003bcc80, 0x18e5530, 0xc0003284c0, 0x203000)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:990 +0x3e

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).runVolumeWorker(...)

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:929

	sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1.3()

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x5c

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004ceee0)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:155 +0x5f

	k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0004ceee0, 0x18b3d60, 0xc000311f80, 0x1, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:156 +0x9b

	k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004ceee0, 0x3b9aca00, 0x0, 0x17a0501, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:133 +0x98

	k8s.io/apimachinery/pkg/util/wait.Until(0xc0004ceee0, 0x3b9aca00, 0xc00008ad80)

		/Users/medya/go/pkg/mod/k8s.io/apimachinery@v0.20.5/pkg/util/wait/wait.go:90 +0x4d

	created by sigs.k8s.io/sig-storage-lib-external-provisioner/v6/controller.(*ProvisionController).Run.func1

		/Users/medya/go/pkg/mod/sigs.k8s.io/sig-storage-lib-external-provisioner/v6@v6.3.0/controller/controller.go:881 +0x3d6

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210813205520-393438 -n pause-20210813205520-393438

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20210813205520-393438 -n pause-20210813205520-393438: exit status 2 (328.045731ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:262: (dbg) Run:  kubectl --context pause-20210813205520-393438 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: 

helpers_test.go:273: ======> post-mortem[TestPause/serial/PauseAgain]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context pause-20210813205520-393438 describe pod 

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context pause-20210813205520-393438 describe pod : exit status 1 (58.284642ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:278: kubectl --context pause-20210813205520-393438 describe pod : exit status 1

--- FAIL: TestPause/serial/PauseAgain (11.90s)