Test Report: Docker_Linux_containerd

Test fail (3/283)

Order	failed test	Duration
243	TestPause/serial/Pause	33.33
244	TestPause/serial/VerifyStatus	13.28
246	TestPause/serial/PauseAgain	34.67

–

TestPause/serial/Pause (33.33s)

=== RUN   TestPause/serial/Pause

pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5

pause_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5: exit status 80 (4.683294064s)

-- stdout --

	* Pausing node pause-20211203024124-532170 ...

-- /stdout --

** stderr **

	I1203 02:42:52.260401  668281 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:42:52.260558  668281 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:52.260567  668281 out.go:310] Setting ErrFile to fd 2...

	I1203 02:42:52.260573  668281 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:52.260739  668281 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:42:52.260965  668281 out.go:304] Setting JSON to false

	I1203 02:42:52.260997  668281 mustload.go:65] Loading cluster: pause-20211203024124-532170

	I1203 02:42:52.261445  668281 config.go:176] Loaded profile config "pause-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:42:52.261994  668281 cli_runner.go:115] Run: docker container inspect pause-20211203024124-532170 --format={{.State.Status}}

	I1203 02:42:52.350978  668281 host.go:66] Checking if "pause-20211203024124-532170" exists ...

	I1203 02:42:52.351362  668281 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:42:52.457734  668281 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:5 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:85 OomKillDisable:true NGoroutines:91 SystemTime:2021-12-03 02:42:52.405574498 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:42:52.642164  668281 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bo

ol=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/13059/minikube-v1.24.0-1638385553-13059.iso https://github.com/kubernetes/minikube/releases/download/v1.24.0-1638385553-13059/minikube-v1.24.0-1638385553-13059.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.24.0-1638385553-13059.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-

plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20211203024124-532170 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I1203 02:42:54.291539  668281 out.go:176] * Pausing node pause-20211203024124-532170 ...

	I1203 02:42:54.291585  668281 host.go:66] Checking if "pause-20211203024124-532170" exists ...

	I1203 02:42:54.291965  668281 ssh_runner.go:195] Run: systemctl --version

	I1203 02:42:54.292031  668281 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211203024124-532170

	I1203 02:42:54.334110  668281 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33286 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/pause-20211203024124-532170/id_rsa Username:docker}

	I1203 02:42:54.413080  668281 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:42:54.422926  668281 pause.go:50] kubelet running: true

	I1203 02:42:54.422990  668281 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I1203 02:42:54.915998  668281 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I1203 02:42:54.916108  668281 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I1203 02:42:55.001665  668281 cri.go:76] found id: "44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8"

	I1203 02:42:55.001730  668281 cri.go:76] found id: "fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf"

	I1203 02:42:55.001739  668281 cri.go:76] found id: "9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a"

	I1203 02:42:55.001745  668281 cri.go:76] found id: "b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf"

	I1203 02:42:55.001751  668281 cri.go:76] found id: "da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd"

	I1203 02:42:55.001759  668281 cri.go:76] found id: "377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac"

	I1203 02:42:55.001766  668281 cri.go:76] found id: "c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83"

	I1203 02:42:55.001773  668281 cri.go:76] found id: "7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4"

	I1203 02:42:55.001781  668281 cri.go:76] found id: ""

	I1203 02:42:55.001850  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1203 02:42:55.045187  668281 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","pid":1680,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d/rootfs","created":"2021-12-03T02:42:20.264783354Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-5xmj2_9b4f2238-af1f-487f-80ff-a0a932437cee"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","pid":991,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d5

37309aa240f93ac2fdfa449c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c/rootfs","created":"2021-12-03T02:41:59.468855551Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20211203024124-532170_d38c5cafc0eadb77f3c31b03ddf6e989"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","pid":1005,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62/rootfs","created":"2021-12-03T02:41:59.568722379Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","i

o.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20211203024124-532170_1d840b763857e30c34b6698e9fa7570f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","pid":1143,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac/rootfs","created":"2021-12-03T02:41:59.92570495Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","pid":2587,"s

tatus":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8/rootfs","created":"2021-12-03T02:42:51.560749945Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","pid":1014,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2/rootfs","created":"2021-12-03T02:41:59.568796096Z","annotations":{"io.kubernetes

.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20211203024124-532170_2b61b38a825a0505d16b2d6a2a9cedfb"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","pid":1687,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2/rootfs","created":"2021-12-03T02:42:20.596836103Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-n6hkm_368971a0-2c0b-44f2-b66d-3257c9f080f4"},"owner":"root"},

{"ociVersion":"1.0.2-dev","id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","pid":998,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195/rootfs","created":"2021-12-03T02:41:59.568737058Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20211203024124-532170_d9c5bb1dd4c0e3a00c6f04d2449fcce4"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","pid":1077,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","r

ootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4/rootfs","created":"2021-12-03T02:41:59.766374576Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","pid":1987,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da/rootfs","created":"2021-12-03T02:42:33.364777884Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","io.kubernetes.cri.sandb

ox-log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-qwmpd_7f97c64e-1e68-4356-a1b5-f77f7cc81b24"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","pid":2556,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f/rootfs","created":"2021-12-03T02:42:51.32106819Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_9aa5302f-010c-4351-96c2-b2485180be47"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","pid":1867,"status":"running","bundle":"/run/containerd/io.conta

inerd.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a/rootfs","created":"2021-12-03T02:42:21.456633358Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","pid":1718,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf/rootfs","created":"2021-12-03T02:42:20.536651488Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.contai

ner-type":"container","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","pid":1136,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83/rootfs","created":"2021-12-03T02:41:59.868290191Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd","pid":1152,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8c

ef0af731ccbbe2fe9f197dd","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd/rootfs","created":"2021-12-03T02:41:59.928696433Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","pid":2019,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf/rootfs","created":"2021-12-03T02:42:33.648769478Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"989b0a2

0cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da"},"owner":"root"}]

	I1203 02:42:55.045428  668281 cri.go:113] list returned 16 containers

	I1203 02:42:55.045443  668281 cri.go:116] container: {ID:1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d Status:running}

	I1203 02:42:55.045477  668281 cri.go:118] skipping 1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d - not in ps

	I1203 02:42:55.045485  668281 cri.go:116] container: {ID:1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c Status:running}

	I1203 02:42:55.045495  668281 cri.go:118] skipping 1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c - not in ps

	I1203 02:42:55.045500  668281 cri.go:116] container: {ID:26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 Status:running}

	I1203 02:42:55.045507  668281 cri.go:118] skipping 26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 - not in ps

	I1203 02:42:55.045514  668281 cri.go:116] container: {ID:377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac Status:running}

	I1203 02:42:55.045521  668281 cri.go:116] container: {ID:44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8 Status:running}

	I1203 02:42:55.045530  668281 cri.go:116] container: {ID:4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 Status:running}

	I1203 02:42:55.045539  668281 cri.go:118] skipping 4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 - not in ps

	I1203 02:42:55.045552  668281 cri.go:116] container: {ID:52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 Status:running}

	I1203 02:42:55.045561  668281 cri.go:118] skipping 52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 - not in ps

	I1203 02:42:55.045566  668281 cri.go:116] container: {ID:75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 Status:running}

	I1203 02:42:55.045573  668281 cri.go:118] skipping 75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 - not in ps

	I1203 02:42:55.045580  668281 cri.go:116] container: {ID:7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4 Status:running}

	I1203 02:42:55.045587  668281 cri.go:116] container: {ID:989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da Status:running}

	I1203 02:42:55.045595  668281 cri.go:118] skipping 989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da - not in ps

	I1203 02:42:55.045600  668281 cri.go:116] container: {ID:9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f Status:running}

	I1203 02:42:55.045614  668281 cri.go:118] skipping 9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f - not in ps

	I1203 02:42:55.045623  668281 cri.go:116] container: {ID:9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a Status:running}

	I1203 02:42:55.045633  668281 cri.go:116] container: {ID:b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf Status:running}

	I1203 02:42:55.045640  668281 cri.go:116] container: {ID:c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83 Status:running}

	I1203 02:42:55.045648  668281 cri.go:116] container: {ID:da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd Status:running}

	I1203 02:42:55.045654  668281 cri.go:116] container: {ID:fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf Status:running}

	I1203 02:42:55.045700  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac

	I1203 02:42:55.062697  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8

	I1203 02:42:55.080693  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4

	I1203 02:42:55.099581  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a

	I1203 02:42:55.116571  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf

	I1203 02:42:55.133319  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83

	I1203 02:42:55.391880  668281 retry.go:31] will retry after 276.165072ms: runc: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:42:55Z" level=error msg="unable to freeze"

	I1203 02:42:55.668280  668281 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:42:55.679598  668281 pause.go:50] kubelet running: false

	I1203 02:42:55.679672  668281 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I1203 02:42:55.779952  668281 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I1203 02:42:55.780052  668281 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I1203 02:42:55.867292  668281 cri.go:76] found id: "44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8"

	I1203 02:42:55.867322  668281 cri.go:76] found id: "fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf"

	I1203 02:42:55.867331  668281 cri.go:76] found id: "9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a"

	I1203 02:42:55.867339  668281 cri.go:76] found id: "b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf"

	I1203 02:42:55.867346  668281 cri.go:76] found id: "da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd"

	I1203 02:42:55.867354  668281 cri.go:76] found id: "377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac"

	I1203 02:42:55.867361  668281 cri.go:76] found id: "c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83"

	I1203 02:42:55.867368  668281 cri.go:76] found id: "7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4"

	I1203 02:42:55.867375  668281 cri.go:76] found id: ""

	I1203 02:42:55.867417  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1203 02:42:55.906466  668281 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","pid":1680,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d/rootfs","created":"2021-12-03T02:42:20.264783354Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-5xmj2_9b4f2238-af1f-487f-80ff-a0a932437cee"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","pid":991,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d5

37309aa240f93ac2fdfa449c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c/rootfs","created":"2021-12-03T02:41:59.468855551Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20211203024124-532170_d38c5cafc0eadb77f3c31b03ddf6e989"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","pid":1005,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62/rootfs","created":"2021-12-03T02:41:59.568722379Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","i

o.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20211203024124-532170_1d840b763857e30c34b6698e9fa7570f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","pid":1143,"status":"paused","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac/rootfs","created":"2021-12-03T02:41:59.92570495Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","pid":2587,"st

atus":"paused","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8/rootfs","created":"2021-12-03T02:42:51.560749945Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","pid":1014,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2/rootfs","created":"2021-12-03T02:41:59.568796096Z","annotations":{"io.kubernetes.c

ri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20211203024124-532170_2b61b38a825a0505d16b2d6a2a9cedfb"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","pid":1687,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2/rootfs","created":"2021-12-03T02:42:20.596836103Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-n6hkm_368971a0-2c0b-44f2-b66d-3257c9f080f4"},"owner":"root"},{"

ociVersion":"1.0.2-dev","id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","pid":998,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195/rootfs","created":"2021-12-03T02:41:59.568737058Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20211203024124-532170_d9c5bb1dd4c0e3a00c6f04d2449fcce4"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","pid":1077,"status":"paused","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","root

fs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4/rootfs","created":"2021-12-03T02:41:59.766374576Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","pid":1987,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da/rootfs","created":"2021-12-03T02:42:33.364777884Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","io.kubernetes.cri.sandbox-

log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-qwmpd_7f97c64e-1e68-4356-a1b5-f77f7cc81b24"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","pid":2556,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f/rootfs","created":"2021-12-03T02:42:51.32106819Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_9aa5302f-010c-4351-96c2-b2485180be47"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","pid":1867,"status":"paused","bundle":"/run/containerd/io.container

d.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a/rootfs","created":"2021-12-03T02:42:21.456633358Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","pid":1718,"status":"paused","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf/rootfs","created":"2021-12-03T02:42:20.536651488Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-t

ype":"container","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","pid":1136,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83/rootfs","created":"2021-12-03T02:41:59.868290191Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd","pid":1152,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af

731ccbbe2fe9f197dd","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd/rootfs","created":"2021-12-03T02:41:59.928696433Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","pid":2019,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf/rootfs","created":"2021-12-03T02:42:33.648769478Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"989b0a20cd6b

f68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da"},"owner":"root"}]

	I1203 02:42:55.906736  668281 cri.go:113] list returned 16 containers

	I1203 02:42:55.906754  668281 cri.go:116] container: {ID:1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d Status:running}

	I1203 02:42:55.906767  668281 cri.go:118] skipping 1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d - not in ps

	I1203 02:42:55.906773  668281 cri.go:116] container: {ID:1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c Status:running}

	I1203 02:42:55.906782  668281 cri.go:118] skipping 1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c - not in ps

	I1203 02:42:55.906787  668281 cri.go:116] container: {ID:26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 Status:running}

	I1203 02:42:55.906796  668281 cri.go:118] skipping 26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 - not in ps

	I1203 02:42:55.906801  668281 cri.go:116] container: {ID:377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac Status:paused}

	I1203 02:42:55.906815  668281 cri.go:122] skipping {377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac paused}: state = "paused", want "running"

	I1203 02:42:55.906831  668281 cri.go:116] container: {ID:44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8 Status:paused}

	I1203 02:42:55.906838  668281 cri.go:122] skipping {44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8 paused}: state = "paused", want "running"

	I1203 02:42:55.906847  668281 cri.go:116] container: {ID:4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 Status:running}

	I1203 02:42:55.906853  668281 cri.go:118] skipping 4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 - not in ps

	I1203 02:42:55.906858  668281 cri.go:116] container: {ID:52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 Status:running}

	I1203 02:42:55.906867  668281 cri.go:118] skipping 52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 - not in ps

	I1203 02:42:55.906872  668281 cri.go:116] container: {ID:75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 Status:running}

	I1203 02:42:55.906882  668281 cri.go:118] skipping 75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 - not in ps

	I1203 02:42:55.906887  668281 cri.go:116] container: {ID:7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4 Status:paused}

	I1203 02:42:55.906896  668281 cri.go:122] skipping {7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4 paused}: state = "paused", want "running"

	I1203 02:42:55.906902  668281 cri.go:116] container: {ID:989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da Status:running}

	I1203 02:42:55.906912  668281 cri.go:118] skipping 989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da - not in ps

	I1203 02:42:55.906917  668281 cri.go:116] container: {ID:9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f Status:running}

	I1203 02:42:55.906926  668281 cri.go:118] skipping 9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f - not in ps

	I1203 02:42:55.906931  668281 cri.go:116] container: {ID:9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a Status:paused}

	I1203 02:42:55.906937  668281 cri.go:122] skipping {9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a paused}: state = "paused", want "running"

	I1203 02:42:55.906946  668281 cri.go:116] container: {ID:b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf Status:paused}

	I1203 02:42:55.906952  668281 cri.go:122] skipping {b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf paused}: state = "paused", want "running"

	I1203 02:42:55.906961  668281 cri.go:116] container: {ID:c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83 Status:running}

	I1203 02:42:55.906967  668281 cri.go:116] container: {ID:da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd Status:running}

	I1203 02:42:55.906976  668281 cri.go:116] container: {ID:fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf Status:running}

	I1203 02:42:55.907025  668281 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83

	I1203 02:42:56.800699  668281 out.go:176]

	W1203 02:42:56.800957  668281 out.go:241] X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:42:56Z" level=error msg="unable to freeze"

	X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:42:56Z" level=error msg="unable to freeze"

	W1203 02:42:56.800978  668281 out.go:241] *

	W1203 02:42:56.816094  668281 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1203 02:42:56.820126  668281 out.go:176]

** /stderr **

pause_test.go:110: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211203024124-532170

helpers_test.go:236: (dbg) docker inspect pause-20211203024124-532170:

-- stdout --

	        "Id": "2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc",

	        "Created": "2021-12-03T02:41:26.275196666Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 651787,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-03T02:41:27.094995507Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hostname",

	        "HostsPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hosts",

	        "LogPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc-json.log",

	        "Name": "/pause-20211203024124-532170",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211203024124-532170:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20211203024124-532170",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf-init/diff:/var/lib/docker/overlay2/6ac4080541cfeacde0b54b862ed3e8c1497bf3d3f22b73f3dd4ce1f668e19c72/diff:/var/lib/docker/overlay2/3e23ff251c4a4f7c2bc4e503098b4a2c6cc61a1d99b51a599fab585fe722bb1b/diff:/var/lib/docker/overlay2/cc6e93735a0ca1de72f287a78429adcbf52754f7b56e82fd10136b36df126cb7/diff:/var/lib/docker/overlay2/9b91525d2aa18b23a08318fd216cf0dd395530e8ee0971ef4ee837687f222c44/diff:/var/lib/docker/overlay2/afd7645dd1e3de615d5e6b8e38717640c35dd9d0dbad5d79e1e72c29f519e047/diff:/var/lib/docker/overlay2/e42185b4ffd5fd72d5dd3032240c65ebde359f8e05c73af3d0187f32c837a786/diff:/var/lib/docker/overlay2/fc00a8e7d591e187ad76a50b07d8c5a06e15c107d4f840ccea15b68e28da1980/diff:/var/lib/docker/overlay2/a29bf1481ece426838b6a498b3effdf9ff07fce93c547917247a80b257a1fe6a/diff:/var/lib/docker/overlay2/d08861a8de693171af3100608e63638de0eff4ee0ab9dad23a141b63c9fc78ba/diff:/var/lib/docker/overlay2/a810fd

33b8bdb6290817982a645db1f3f53d332f221af803394694d926de6ca1/diff:/var/lib/docker/overlay2/82d5a8bdd562d849d98ab607f16a3a733ccc7b8f078412597b1324d4fadd3be1/diff:/var/lib/docker/overlay2/1a93d862337e75ae7f4350d3b11066c9de4c24aceee76546de610057f617281d/diff:/var/lib/docker/overlay2/016cb2f9bec981cb59ea9c574c581bad8e88da405748168504b409ab365eb79b/diff:/var/lib/docker/overlay2/83e41d3d061b2ae009fb28d0223691d1ec84632e4b835f49eec164d4466dae2d/diff:/var/lib/docker/overlay2/0ce62a53786be1b733f4d9a3f0bb5d6eddb1df23134f5b87286ea0a0cf9fbbf0/diff:/var/lib/docker/overlay2/c13141fe83f4579fcc3d40c499982793faebda827f5ca6cc5534911b1ec393f6/diff:/var/lib/docker/overlay2/55fce7735b2305346d30a554960b07ae732bacdfbc399692dd2506c80daf9877/diff:/var/lib/docker/overlay2/252a160a3b32162d3ff13c40ccc33cabd273340235797ebee736493a1029eda7/diff:/var/lib/docker/overlay2/fce6704ef3f6cc37735e8972372e0f5e0bfbf4af83f5ff6fd027e174c59578e0/diff:/var/lib/docker/overlay2/88c75fcb26b5194e243c651225b00fb638c5ea62eb979d7df5b728df5ef5195a/diff:/var/lib/d

ocker/overlay2/0771e6e29be058dc4b8a5521020f5d66e3e4f0996747baea7cb18371e3545b6b/diff:/var/lib/docker/overlay2/9b15999e93e34bb79fccce68ef9de2dfe1780f1d4c0595f52d15981d7090babb/diff:/var/lib/docker/overlay2/8fd40ec7570ab0690e15c09834e3bc5284b3badf0f5b98cf234cc063d023fbce/diff:/var/lib/docker/overlay2/317d010d230847ac38e52570cb1bf66b55a735ba2fcd26045ca1d928fee269e9/diff:/var/lib/docker/overlay2/9e0744f6558a5e30811c7bc770686bb03018000ec5504f0a7342d648858c6520/diff:/var/lib/docker/overlay2/2b1e4978e05c0bbd41e0db471a4546b47e88d4d07bba062e641ee19252fbe324/diff:/var/lib/docker/overlay2/8a5ad66f897aa93b3a59cb81de4d6f3a4437cdf29b1daaac0470479e0627d353/diff:/var/lib/docker/overlay2/4c73a8fc02a1854c714f156081c2ed75e595e3dde9226820f21ff9353b52fbb7/diff:/var/lib/docker/overlay2/be02751327b17c0e71631c5e6cbea324ca807f35ff112d906955328aabd427d8/diff:/var/lib/docker/overlay2/500480e16cba6dcc737fbaabcd657d62a6d877b3505eec63f1de6e5e3c9dbb92/diff:/var/lib/docker/overlay2/2cd99ae5cfb49d19c25b95ac17d84a6889e691672d6d93a9f066ca8b7c4

5289f/diff:/var/lib/docker/overlay2/bc1787830a034113efe9235ddf0dc8652dfff6e7926a63d839120bbe9ebc0b99/diff:/var/lib/docker/overlay2/44149fe8e3297368fee684058e3d52cef2712454b3145aa883bcb63bbae8542f/diff:/var/lib/docker/overlay2/433b47ea5ada41625d6479daf7944dc706ab5abbcad92f65a32b40a754cbf645/diff:/var/lib/docker/overlay2/77082cd9d165ff33aaddc632231ac2ea8dc30f9073037fc9c3c97f50db12d5b2/diff:/var/lib/docker/overlay2/631d81e1d8b807f0a941170215bfd43566c2823909251d69246f84dc74dff425/diff:/var/lib/docker/overlay2/6eb234f85614a81f5323a7f51a68384027e94afd402c9851374d990371ebf594/diff:/var/lib/docker/overlay2/8c188ae964eaa37da1b63d82bc30f6d81e8a06ee2c1af3f12719f9cf443b6e09/diff:/var/lib/docker/overlay2/86d4eaadf1b0680172d06e3118a53a77440af3c8e5bde8c29bb97e7f94599244/diff:/var/lib/docker/overlay2/78fadeb69e3f7825d1bad64e2e686eff962fc4ed859de8fd0d2b2d30d56510a1/diff",

	                "MergedDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/merged",

	                "UpperDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/diff",

	                "WorkDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20211203024124-532170",

	                "Source": "/var/lib/docker/volumes/pause-20211203024124-532170/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20211203024124-532170",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "name.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c1242b1b033f16bedee595a0280553c95576e94729234572b5dbfcbd58cee8ec",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33286"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33285"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33282"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33284"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33283"

},

	            "SandboxKey": "/var/run/docker/netns/c1242b1b033f",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211203024124-532170": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "2fc356be3f9a"

],

	                    "NetworkID": "da1d0795a7d3bb5f007c696fba96d61b49ce95f6e99122ac37e1226dd45b8f38",

	                    "EndpointID": "59b7bb705dfc9e261679395a707aa0e1863d48a4a93f55f99fdcc3b7f3f19ed3",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (2.604427428s)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25

=== CONT  TestPause/serial/Pause

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25: (12.610027161s)

helpers_test.go:253: TestPause/serial/Pause logs:

-- stdout --

	* ==> Audit <==

	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | -p                                         | multinode-20211203022621-532170-m03        | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:38 UTC | Fri, 03 Dec 2021 02:36:40 UTC |

	|         | multinode-20211203022621-532170-m03        |                                            |         |         |                               |                               |

	| delete  | -p                                         | multinode-20211203022621-532170            | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:40 UTC | Fri, 03 Dec 2021 02:36:46 UTC |

	|         | multinode-20211203022621-532170            |                                            |         |         |                               |                               |

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:46 UTC | Fri, 03 Dec 2021 02:38:22 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | --wait=true --preload=false                |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:22 UTC | Fri, 03 Dec 2021 02:38:25 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl pull busybox                |                                            |         |         |                               |                               |

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:25 UTC | Fri, 03 Dec 2021 02:39:08 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=docker           |                                            |         |         |                               |                               |

	|         |  --container-runtime=containerd            |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:08 UTC | Fri, 03 Dec 2021 02:39:09 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl image ls                    |                                            |         |         |                               |                               |

	| delete  | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:09 UTC | Fri, 03 Dec 2021 02:39:12 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:12 UTC | Fri, 03 Dec 2021 02:39:53 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:54 UTC | Fri, 03 Dec 2021 02:39:54 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:40:20 UTC | Fri, 03 Dec 2021 02:40:56 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --schedule 15s                             |                                            |         |         |                               |                               |

	| delete  | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:05 UTC | Fri, 03 Dec 2021 02:41:10 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	| delete  | -p                                         | insufficient-storage-20211203024110-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:17 UTC | Fri, 03 Dec 2021 02:41:24 UTC |

	|         | insufficient-storage-20211203024110-532170 |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:41:32 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --no-kubernetes --driver=docker            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| profile | list                                       | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:33 UTC |

	| profile | list --output=json                         | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:34 UTC |

	| stop    | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:34 UTC | Fri, 03 Dec 2021 02:41:35 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:35 UTC | Fri, 03 Dec 2021 02:41:53 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:53 UTC | Fri, 03 Dec 2021 02:41:59 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| delete  | -p                                         | kubenet-20211203024159-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:00 UTC | Fri, 03 Dec 2021 02:42:00 UTC |

	|         | kubenet-20211203024159-532170              |                                            |         |         |                               |                               |

	| delete  | -p                                         | flannel-20211203024200-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:01 UTC | Fri, 03 Dec 2021 02:42:01 UTC |

	|         | flannel-20211203024200-532170              |                                            |         |         |                               |                               |

	| delete  | -p false-20211203024201-532170             | false-20211203024201-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:02 UTC | Fri, 03 Dec 2021 02:42:02 UTC |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:36 UTC |

	|         | --memory=2048                              |                                            |         |         |                               |                               |

	|         | --install-addons=false                     |                                            |         |         |                               |                               |

	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| start   | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:45 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |

	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:45 UTC | Fri, 03 Dec 2021 02:42:49 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:36 UTC | Fri, 03 Dec 2021 02:42:52 UTC |

	|         | --alsologtostderr                          |                                            |         |         |                               |                               |

	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:42:51

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:42:51.961276  668072 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:42:51.961377  668072 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:51.961383  668072 out.go:310] Setting ErrFile to fd 2...

	I1203 02:42:51.961389  668072 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:51.961546  668072 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:42:51.961815  668072 out.go:304] Setting JSON to false

	I1203 02:42:52.026252  668072 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":15933,"bootTime":1638483439,"procs":309,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:42:52.026414  668072 start.go:122] virtualization: kvm guest

	I1203 02:42:52.028967  668072 out.go:176] * [running-upgrade-20211203024210-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:42:52.030832  668072 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:42:52.029221  668072 notify.go:174] Checking for updates...

	I1203 02:42:52.032438  668072 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:42:52.034238  668072 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:42:52.041293  668072 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:42:52.042326  668072 config.go:176] Loaded profile config "running-upgrade-20211203024210-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:42:51.197265  663241 pod_ready.go:92] pod "kube-scheduler-pause-20211203024124-532170" in "kube-system" namespace has status "Ready":"True"

	I1203 02:42:51.197290  663241 pod_ready.go:81] duration metric: took 398.571463ms waiting for pod "kube-scheduler-pause-20211203024124-532170" in "kube-system" namespace to be "Ready" ...

	I1203 02:42:51.197303  663241 pod_ready.go:38] duration metric: took 872.56713ms for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1203 02:42:51.197329  663241 api_server.go:51] waiting for apiserver process to appear ...

	I1203 02:42:51.197370  663241 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:42:51.232106  663241 api_server.go:71] duration metric: took 1.015659557s to wait for apiserver process to appear ...

	I1203 02:42:51.232136  663241 api_server.go:87] waiting for apiserver healthz status ...

	I1203 02:42:51.232151  663241 api_server.go:240] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I1203 02:42:51.240577  663241 api_server.go:266] https://192.168.49.2:8443/healthz returned 200:

ok

	I1203 02:42:51.241642  663241 api_server.go:140] control plane version: v1.22.4

	I1203 02:42:51.241663  663241 api_server.go:130] duration metric: took 9.520048ms to wait for apiserver health ...

	I1203 02:42:51.241673  663241 system_pods.go:43] waiting for kube-system pods to appear ...

	I1203 02:42:51.399913  663241 system_pods.go:59] 8 kube-system pods found

	I1203 02:42:51.399953  663241 system_pods.go:61] "coredns-78fcd69978-qwmpd" [7f97c64e-1e68-4356-a1b5-f77f7cc81b24] Running

	I1203 02:42:51.399962  663241 system_pods.go:61] "etcd-pause-20211203024124-532170" [f00da2d2-7bda-4c00-8af5-91a118020c28] Running

	I1203 02:42:51.399968  663241 system_pods.go:61] "kindnet-n6hkm" [368971a0-2c0b-44f2-b66d-3257c9f080f4] Running

	I1203 02:42:51.399974  663241 system_pods.go:61] "kube-apiserver-pause-20211203024124-532170" [bdf80ccc-7fc5-4aae-9267-d2bbe3f31284] Running

	I1203 02:42:51.399982  663241 system_pods.go:61] "kube-controller-manager-pause-20211203024124-532170" [87fb4ea5-8e16-4988-98e9-230278ac2373] Running

	I1203 02:42:51.399987  663241 system_pods.go:61] "kube-proxy-5xmj2" [9b4f2238-af1f-487f-80ff-a0a932437cee] Running

	I1203 02:42:51.399994  663241 system_pods.go:61] "kube-scheduler-pause-20211203024124-532170" [c5cc016b-3a88-43cd-8b4e-4dcef97d1600] Running

	I1203 02:42:51.400004  663241 system_pods.go:61] "storage-provisioner" [9aa5302f-010c-4351-96c2-b2485180be47] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1203 02:42:51.400018  663241 system_pods.go:74] duration metric: took 158.339574ms to wait for pod list to return data ...

	I1203 02:42:51.400030  663241 default_sa.go:34] waiting for default service account to be created ...

	I1203 02:42:51.599179  663241 default_sa.go:45] found service account: "default"

	I1203 02:42:51.599209  663241 default_sa.go:55] duration metric: took 199.172303ms for default service account to be created ...

	I1203 02:42:51.599221  663241 system_pods.go:116] waiting for k8s-apps to be running ...

	I1203 02:42:51.800091  663241 system_pods.go:86] 8 kube-system pods found

	I1203 02:42:51.800124  663241 system_pods.go:89] "coredns-78fcd69978-qwmpd" [7f97c64e-1e68-4356-a1b5-f77f7cc81b24] Running

	I1203 02:42:51.800134  663241 system_pods.go:89] "etcd-pause-20211203024124-532170" [f00da2d2-7bda-4c00-8af5-91a118020c28] Running

	I1203 02:42:51.800140  663241 system_pods.go:89] "kindnet-n6hkm" [368971a0-2c0b-44f2-b66d-3257c9f080f4] Running

	I1203 02:42:51.800147  663241 system_pods.go:89] "kube-apiserver-pause-20211203024124-532170" [bdf80ccc-7fc5-4aae-9267-d2bbe3f31284] Running

	I1203 02:42:51.800153  663241 system_pods.go:89] "kube-controller-manager-pause-20211203024124-532170" [87fb4ea5-8e16-4988-98e9-230278ac2373] Running

	I1203 02:42:51.800160  663241 system_pods.go:89] "kube-proxy-5xmj2" [9b4f2238-af1f-487f-80ff-a0a932437cee] Running

	I1203 02:42:51.800166  663241 system_pods.go:89] "kube-scheduler-pause-20211203024124-532170" [c5cc016b-3a88-43cd-8b4e-4dcef97d1600] Running

	I1203 02:42:51.800176  663241 system_pods.go:89] "storage-provisioner" [9aa5302f-010c-4351-96c2-b2485180be47] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1203 02:42:51.800193  663241 system_pods.go:126] duration metric: took 200.966966ms to wait for k8s-apps to be running ...

	I1203 02:42:51.800204  663241 system_svc.go:44] waiting for kubelet service to be running ....

	I1203 02:42:51.800252  663241 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:42:51.813899  663241 system_svc.go:56] duration metric: took 13.683891ms WaitForService to wait for kubelet.

	I1203 02:42:51.813931  663241 kubeadm.go:547] duration metric: took 1.597491319s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1203 02:42:51.813963  663241 node_conditions.go:102] verifying NodePressure condition ...

	I1203 02:42:51.999851  663241 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I1203 02:42:51.999884  663241 node_conditions.go:123] node cpu capacity is 8

	I1203 02:42:51.999901  663241 node_conditions.go:105] duration metric: took 185.932844ms to run NodePressure ...

	I1203 02:42:51.999916  663241 start.go:234] waiting for startup goroutines ...

	I1203 02:42:52.097263  663241 start.go:486] kubectl: 1.20.5, cluster: 1.22.4 (minor skew: 2)

	I1203 02:42:52.099032  663241 out.go:176]

	W1203 02:42:52.099217  663241 out.go:241] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.4.

	I1203 02:42:52.102250  663241 out.go:176]   - Want kubectl v1.22.4? Try 'minikube kubectl -- get pods -A'

	I1203 02:42:52.106560  663241 out.go:176] * Done! kubectl is now configured to use "pause-20211203024124-532170" cluster and "default" namespace by default

	I1203 02:42:52.047008  668072 out.go:176] * Kubernetes 1.22.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.4

	I1203 02:42:52.047071  668072 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:42:52.131601  668072 docker.go:132] docker version: linux-19.03.15

	I1203 02:42:52.131709  668072 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:42:52.319104  668072 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:5 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:83 OomKillDisable:true NGoroutines:88 SystemTime:2021-12-03 02:42:52.208265697 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:42:52.319277  668072 docker.go:237] overlay module found

	I1203 02:42:52.322582  668072 out.go:176] * Using the docker driver based on existing profile

	I1203 02:42:52.322622  668072 start.go:280] selected driver: docker

	I1203 02:42:52.322790  668072 start.go:775] validating driver "docker" against &{Name:running-upgrade-20211203024210-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20211203024210-532170 Namespace:default APIServerName:m

inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.70.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:42:52.322913  668072 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:42:52.322962  668072 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:42:52.322987  668072 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:42:52.324913  668072 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:42:52.326103  668072 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:42:52.436205  668072 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:5 ContainersRunning:5 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:84 OomKillDisable:true NGoroutines:90 SystemTime:2021-12-03 02:42:52.377793694 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W1203 02:42:52.436318  668072 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:42:52.436348  668072 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:42:52.681871  668072 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:42:52.682124  668072 cni.go:93] Creating CNI manager for ""

	I1203 02:42:52.682145  668072 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:42:52.682160  668072 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:42:52.682166  668072 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:42:52.682176  668072 start_flags.go:282] config:

	{Name:running-upgrade-20211203024210-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20211203024210-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.70.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:42:49.634574  666582 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1203 02:42:49.634862  666582 start.go:160] libmachine.API.Create for "force-systemd-env-20211203024249-532170" (driver="docker")

	I1203 02:42:49.634895  666582 client.go:168] LocalClient.Create starting

	I1203 02:42:49.634994  666582 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem

	I1203 02:42:49.635030  666582 main.go:130] libmachine: Decoding PEM data...

	I1203 02:42:49.635051  666582 main.go:130] libmachine: Parsing certificate...

	I1203 02:42:49.635136  666582 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem

	I1203 02:42:49.635157  666582 main.go:130] libmachine: Decoding PEM data...

	I1203 02:42:49.635171  666582 main.go:130] libmachine: Parsing certificate...

	I1203 02:42:49.635597  666582 cli_runner.go:115] Run: docker network inspect force-systemd-env-20211203024249-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1203 02:42:49.683508  666582 cli_runner.go:162] docker network inspect force-systemd-env-20211203024249-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1203 02:42:49.683596  666582 network_create.go:254] running [docker network inspect force-systemd-env-20211203024249-532170] to gather additional debugging logs...

	I1203 02:42:49.683619  666582 cli_runner.go:115] Run: docker network inspect force-systemd-env-20211203024249-532170

	W1203 02:42:49.735645  666582 cli_runner.go:162] docker network inspect force-systemd-env-20211203024249-532170 returned with exit code 1

	I1203 02:42:49.735683  666582 network_create.go:257] error running [docker network inspect force-systemd-env-20211203024249-532170]: docker network inspect force-systemd-env-20211203024249-532170: exit status 1

	stdout:

[]

	stderr:

	Error: No such network: force-systemd-env-20211203024249-532170

	I1203 02:42:49.735706  666582 network_create.go:259] output of [docker network inspect force-systemd-env-20211203024249-532170]: -- stdout --

[]

	-- /stdout --

	** stderr **

	Error: No such network: force-systemd-env-20211203024249-532170

	** /stderr **

	I1203 02:42:49.735772  666582 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:42:49.795450  666582 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-da1d0795a7d3 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:57:ce:ae:c0}}

	I1203 02:42:49.796578  666582 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.58.0:0xc0006da360] misses:0}

	I1203 02:42:49.796625  666582 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1203 02:42:49.796646  666582 network_create.go:106] attempt to create docker network force-systemd-env-20211203024249-532170 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...

	I1203 02:42:49.796703  666582 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true force-systemd-env-20211203024249-532170

	I1203 02:42:49.890691  666582 network_create.go:90] docker network force-systemd-env-20211203024249-532170 192.168.58.0/24 created

	I1203 02:42:49.890734  666582 kic.go:106] calculated static IP "192.168.58.2" for the "force-systemd-env-20211203024249-532170" container

	I1203 02:42:49.890817  666582 cli_runner.go:115] Run: docker ps -a --format {{.Names}}

	I1203 02:42:49.943574  666582 cli_runner.go:115] Run: docker volume create force-systemd-env-20211203024249-532170 --label name.minikube.sigs.k8s.io=force-systemd-env-20211203024249-532170 --label created_by.minikube.sigs.k8s.io=true

	I1203 02:42:50.008492  666582 oci.go:102] Successfully created a docker volume force-systemd-env-20211203024249-532170

	I1203 02:42:50.008584  666582 cli_runner.go:115] Run: docker run --rm --name force-systemd-env-20211203024249-532170-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20211203024249-532170 --entrypoint /usr/bin/test -v force-systemd-env-20211203024249-532170:/var gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c -d /var/lib

	I1203 02:42:51.009093  666582 cli_runner.go:168] Completed: docker run --rm --name force-systemd-env-20211203024249-532170-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20211203024249-532170 --entrypoint /usr/bin/test -v force-systemd-env-20211203024249-532170:/var gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c -d /var/lib: (1.000465905s)

	I1203 02:42:51.009136  666582 oci.go:106] Successfully prepared a docker volume force-systemd-env-20211203024249-532170

	W1203 02:42:51.009180  666582 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	W1203 02:42:51.009198  666582 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	I1203 02:42:51.009262  666582 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1203 02:42:51.009271  666582 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:42:51.009308  666582 kic.go:179] Starting extracting preloaded images to volume ...

	I1203 02:42:51.009413  666582 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-env-20211203024249-532170:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c -I lz4 -xf /preloaded.tar -C /extractDir

	I1203 02:42:51.186825  666582 cli_runner.go:115] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-env-20211203024249-532170 --name force-systemd-env-20211203024249-532170 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20211203024249-532170 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-env-20211203024249-532170 --network force-systemd-env-20211203024249-532170 --ip 192.168.58.2 --volume force-systemd-env-20211203024249-532170:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c

	I1203 02:42:51.807228  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Running}}

	I1203 02:42:51.866586  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Status}}

	I1203 02:42:51.930312  666582 cli_runner.go:115] Run: docker exec force-systemd-env-20211203024249-532170 stat /var/lib/dpkg/alternatives/iptables

	I1203 02:42:52.085168  666582 oci.go:281] the created container "force-systemd-env-20211203024249-532170" has a running status.

	I1203 02:42:52.085200  666582 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/force-systemd-env-20211203024249-532170/id_rsa...

	I1203 02:42:52.230639  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/force-systemd-env-20211203024249-532170/id_rsa.pub -> /home/docker/.ssh/authorized_keys

	I1203 02:42:52.230695  666582 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/force-systemd-env-20211203024249-532170/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1203 02:42:52.970980  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Status}}

	I1203 02:42:53.019240  666582 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1203 02:42:53.019262  666582 kic_runner.go:114] Args: [docker exec --privileged force-systemd-env-20211203024249-532170 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1203 02:42:54.811992  668072 out.go:176] * Starting control plane node running-upgrade-20211203024210-532170 in cluster running-upgrade-20211203024210-532170

	I1203 02:42:54.812064  668072 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:42:56.382861  668072 out.go:176] * Pulling base image ...

	I1203 02:42:56.382923  668072 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:42:56.383057  668072 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon

	I1203 02:42:56.479120  668072 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon, skipping pull

	I1203 02:42:56.479149  668072 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 exists in daemon, skipping load

	W1203 02:42:56.506752  668072 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.20.0-containerd-overlay2-amd64.tar.lz4 status code: 404

	I1203 02:42:56.506930  668072 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/config.json ...

	I1203 02:42:56.507022  668072 cache.go:107] acquiring lock: {Name:mk3f28e99ceac9e8992f0b3b268ec7281c4e72db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507077  668072 cache.go:107] acquiring lock: {Name:mk58b755235faafd792a55ffc678df1b94a68bed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507083  668072 cache.go:107] acquiring lock: {Name:mke6a8256f44fd34328c51d78e752dc7a2edad5e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507192  668072 cache.go:107] acquiring lock: {Name:mk52be53a20a12a6477d4b0e8db57a1c19c9d6b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507262  668072 cache.go:107] acquiring lock: {Name:mk7261047b045f5003b0a1499b53e56c4066fef9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507284  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 exists

	I1203 02:42:56.507302  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists

	I1203 02:42:56.507306  668072 cache.go:96] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7" took 271.401µs

	I1203 02:42:56.507322  668072 cache.go:80] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 succeeded

	I1203 02:42:56.507336  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists

	I1203 02:42:56.507328  668072 cache.go:96] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 144.759µs

	I1203 02:42:56.507345  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists

	I1203 02:42:56.507350  668072 cache.go:80] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded

	I1203 02:42:56.507342  668072 cache.go:107] acquiring lock: {Name:mkd85507bf8f9ec9c5c7efbe7e495c72c5a5c6cf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507348  668072 cache.go:107] acquiring lock: {Name:mke201119b191dfece838cdcc83d982d296b3f34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507362  668072 cache.go:96] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 94.939µs

	I1203 02:42:56.507376  668072 cache.go:80] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded

	I1203 02:42:56.507360  668072 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 353.673µs

	I1203 02:42:56.507385  668072 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded

	I1203 02:42:56.507382  668072 cache.go:107] acquiring lock: {Name:mk807a6c3536c72c72f3be8529e05e94b09807ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507402  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists

	I1203 02:42:56.507403  668072 cache.go:107] acquiring lock: {Name:mk596458ff611e0392f6a3eaa557e2f3e7e8e7a2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.507711  668072 cache.go:96] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 543.549µs

	I1203 02:42:56.507754  668072 cache.go:80] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded

	I1203 02:42:56.507836  668072 cache.go:107] acquiring lock: {Name:mk15948f5fe3546c3f6679e86494b38857a18360 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.508043  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists

	I1203 02:42:56.508069  668072 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 666.176µs

	I1203 02:42:56.508088  668072 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded

	I1203 02:42:56.508129  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists

	I1203 02:42:56.508148  668072 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.012254ms

	I1203 02:42:56.508166  668072 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded

	I1203 02:42:56.508200  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I1203 02:42:56.508214  668072 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 837.091µs

	I1203 02:42:56.508226  668072 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I1203 02:42:56.508257  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists

	I1203 02:42:56.508269  668072 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 1.174072ms

	I1203 02:42:56.508277  668072 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded

	I1203 02:42:56.508303  668072 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 exists

	I1203 02:42:56.508315  668072 cache.go:96] cache image "docker.io/kubernetesui/dashboard:v2.3.1" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1" took 915.402µs

	I1203 02:42:56.508331  668072 cache.go:80] save to tar file docker.io/kubernetesui/dashboard:v2.3.1 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 succeeded

	I1203 02:42:56.508341  668072 cache.go:87] Successfully saved all images to host disk.

	I1203 02:42:56.811418  668072 cache.go:206] Successfully downloaded all kic artifacts

	I1203 02:42:56.811480  668072 start.go:313] acquiring machines lock for running-upgrade-20211203024210-532170: {Name:mkc65e2b625c3fa4d4186ddf14bfaee35a2f74a0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:42:56.811721  668072 start.go:317] acquired machines lock for "running-upgrade-20211203024210-532170" in 207.453µs

	I1203 02:42:56.811754  668072 start.go:93] Skipping create...Using existing machine configuration

	I1203 02:42:56.811761  668072 fix.go:55] fixHost starting:

	I1203 02:42:56.812076  668072 cli_runner.go:115] Run: docker container inspect running-upgrade-20211203024210-532170 --format={{.State.Status}}

	I1203 02:42:56.869665  668072 fix.go:108] recreateIfNeeded on running-upgrade-20211203024210-532170: state=Running err=<nil>

	W1203 02:42:58.017020  668072 fix.go:134] unexpected machine state, will restart: <nil>

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	44ad2903327a4       6e38f40d628db       8 seconds ago        Running             storage-provisioner       0                   9d44abe734bc7

	fa412d0bc64fe       8d147537fb7d1       26 seconds ago       Running             coredns                   0                   989b0a20cd6bf

	9fe05a46928d7       6de166512aa22       39 seconds ago       Running             kindnet-cni               0                   52fd468fab925

	b96a30f689aa8       edeff87e48029       39 seconds ago       Running             kube-proxy                0                   1150dc7540b90

	da77c4c16ea38       0ce02f92d3e43       About a minute ago   Running             kube-controller-manager   0                   75715f0308eb1

	377954dfce779       721ba97f54a65       About a minute ago   Running             kube-scheduler            0                   4b59fc65934a4

	c6bb5925aa26b       0048118155842       About a minute ago   Running             etcd                      0                   26442a09720c6

	7861cc2da74e1       8a5cc299272d9       About a minute ago   Running             kube-apiserver            0                   1a438759f3a6e

	* ==> containerd <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:00 UTC. --

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222703254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222716851Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222726647Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222848435Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222920521Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc00041ffb0 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:true} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugin

ConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223014188Z" level=info msg="Connect containerd service"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223064254Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223824728Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223940610Z" level=info msg="Start subscribing containerd event"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224031243Z" level=info msg="Start recovering state"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224569581Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224644393Z" level=info msg=serving... address=/run/containerd/containerd.sock

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224702180Z" level=info msg="containerd successfully booted in 0.040989s"

	Dec 03 02:42:38 pause-20211203024124-532170 systemd[1]: Started containerd container runtime.

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310686273Z" level=info msg="Start event monitor"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310736093Z" level=info msg="Start snapshots syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310744594Z" level=info msg="Start cni network conf syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310757514Z" level=info msg="Start streaming server"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.156621095Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.186943591Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f pid=2529

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.361766697Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,} returns sandbox id \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.365150740Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.436686048Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.437875321Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.586425386Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\" returns successfully"

	* ==> coredns [fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* ==> dmesg <==

	* [  +1.203764] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev veth344f8041

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff de 19 e6 42 b4 2c 08 06        .........B.,..

	[Dec 3 02:35] cgroup: cgroup2: unknown option "nsdelegate"

	[ +43.145422] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.997001] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethae8775a3

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 09 60 d3 6c 6f 08 06        ........`.lo..

	[Dec 3 02:36] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:38] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc07b7bb4

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 9a 08 d6 d0 27 5c 08 06        ..........'\..

	[Dec 3 02:39] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:40] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth5d5f7a44

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 9e b4 3b e2 7b 9d 08 06        ........;.{...

	[Dec 3 02:41] cgroup: cgroup2: unknown option "nsdelegate"

	[ +14.204723] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.025718] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.991957] cgroup: cgroup2: unknown option "nsdelegate"

	[ +19.678388] cgroup: cgroup2: unknown option "nsdelegate"

	[  +2.060023] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:42] cgroup: cgroup2: unknown option "nsdelegate"

	[ +13.603429] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth170a53a8

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 4a 38 90 3b cc 08 06        .......J8.;...

	[  +9.575101] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethe30be4e2

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa eb 14 cd 69 e4 08 06        ..........i...

	[  +9.369686] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:43] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83] <==

	* {"level":"warn","ts":"2021-12-03T02:42:54.631Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.361717606s","expected-duration":"1s"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.854169973s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4890"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[725459631] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:529; }","duration":"1.854256104s","start":"2021-12-03T02:42:52.998Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[725459631] 'range keys from in-memory index tree'  (duration: 1.854072249s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.582355422s","expected-duration":"100ms","prefix":"","request":"header:<ID:8128009408346100277 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >>","response":"size:16"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:52.998Z","time spent":"1.854314416s","remote":"127.0.0.1:33866","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4914,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[615955715] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"1.188717958s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[615955715] 'read index received'  (duration: 968.013476ms)","trace[615955715] 'applied index is now lower than readState.Index'  (duration: 220.703541ms)"],"step_count":2}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1851729177] transaction","detail":"{read_only:false; response_revision:530; number_of_response:1; }","duration":"1.582656878s","start":"2021-12-03T02:42:53.270Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1851729177] 'compare'  (duration: 1.582261694s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.613711605s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.188840443s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1129"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[43474745] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:530; }","duration":"1.188875717s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[43474745] 'agreement among raft nodes before linearized reading'  (duration: 1.188815061s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1805756956] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:529; }","duration":"1.613993557s","start":"2021-12-03T02:42:53.238Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1805756956] 'range keys from in-memory index tree'  (duration: 1.61359796s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.664Z","time spent":"1.188915825s","remote":"127.0.0.1:33864","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1153,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.238Z","time spent":"1.614050289s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.853Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.270Z","time spent":"1.582731298s","remote":"127.0.0.1:33918","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":598,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >"}

	{"level":"warn","ts":"2021-12-03T02:42:55.362Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:55.862Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.363Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.800Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.939127407s","expected-duration":"1s"}

	{"level":"info","ts":"2021-12-03T02:42:56.800Z","caller":"traceutil/trace.go:171","msg":"trace[121078242] linearizableReadLoop","detail":"{readStateIndex:549; appliedIndex:549; }","duration":"1.939141286s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.800Z","steps":["trace[121078242] 'read index received'  (duration: 1.939133379s)","trace[121078242] 'applied index is now lower than readState.Index'  (duration: 6.677µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.953947612s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/kubernetes\" ","response":"range_response_count:1 size:706"}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.95289822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[634251822] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:531; }","duration":"1.953003147s","start":"2021-12-03T02:42:54.862Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[634251822] 'agreement among raft nodes before linearized reading'  (duration: 1.938259419s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[1182520940] range","detail":"{range_begin:/registry/services/specs/default/kubernetes; range_end:; response_count:1; response_revision:531; }","duration":"1.954019471s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[1182520940] 'agreement among raft nodes before linearized reading'  (duration: 1.93925253s)","trace[1182520940] 'range keys from in-memory index tree'  (duration: 14.649038ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.862Z","time spent":"1.953050451s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.861Z","time spent":"1.954077543s","remote":"127.0.0.1:33880","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":1,"response size":730,"request content":"key:\"/registry/services/specs/default/kubernetes\" "}

	* ==> kernel <==

	*  02:43:11 up  4:25,  0 users,  load average: 9.92, 4.17, 2.19

	Linux pause-20211203024124-532170 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4] <==

	* Trace[1329700100]: ---"About to write a response" 7966ms (02:42:32.807)

	Trace[1329700100]: [7.966737646s] [7.966737646s] END

	I1203 02:42:32.808554       1 trace.go:205] Trace[10124701]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:03c422dd-754f-491f-8b0f-8cda1b614985,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:30.264) (total time: 2543ms):

	Trace[10124701]: ---"About to write a response" 2537ms (02:42:32.801)

	Trace[10124701]: [2.543694862s] [2.543694862s] END

	I1203 02:42:32.811479       1 trace.go:205] Trace[1566228004]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:31.447) (total time: 1363ms):

	Trace[1566228004]: ---"Transaction committed" 1363ms (02:42:32.811)

	Trace[1566228004]: [1.363871215s] [1.363871215s] END

	I1203 02:42:32.811607       1 trace.go:205] Trace[659618151]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:7f82b614-c0f3-45b7-a7e7-fd4d532ee2df,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:31.447) (total time: 1364ms):

	Trace[659618151]: ---"Object stored in database" 1363ms (02:42:32.811)

	Trace[659618151]: [1.364142405s] [1.364142405s] END

	I1203 02:42:54.853636       1 trace.go:205] Trace[921726475]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[921726475]: ---"Transaction committed" 1583ms (02:42:54.853)

	Trace[921726475]: [1.584390803s] [1.584390803s] END

	I1203 02:42:54.853975       1 trace.go:205] Trace[719452703]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:2d516ca3-d159-452f-a840-f129cf10d146,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[719452703]: ---"Object stored in database" 1584ms (02:42:54.853)

	Trace[719452703]: [1.584903164s] [1.584903164s] END

	I1203 02:42:54.854055       1 trace.go:205] Trace[1850500647]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:4359df40-5daa-4a50-bd70-f48390ea66ec,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.663) (total time: 1190ms):

	Trace[1850500647]: ---"About to write a response" 1190ms (02:42:54.853)

	Trace[1850500647]: [1.190501383s] [1.190501383s] END

	I1203 02:42:54.857513       1 trace.go:205] Trace[746149164]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (03-Dec-2021 02:42:52.997) (total time: 1859ms):

	Trace[746149164]: [1.859677903s] [1.859677903s] END

	I1203 02:42:54.858039       1 trace.go:205] Trace[100308926]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:9ee7eb23-38af-4c85-8170-deb854735830,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:52.997) (total time: 1860ms):

	Trace[100308926]: ---"Listing from storage done" 1859ms (02:42:54.857)

	Trace[100308926]: [1.860215353s] [1.860215353s] END

	* ==> kube-controller-manager [da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd] <==

	* I1203 02:42:19.598296       1 shared_informer.go:247] Caches are synced for crt configmap

	I1203 02:42:19.598317       1 shared_informer.go:247] Caches are synced for bootstrap_signer

	I1203 02:42:19.598432       1 shared_informer.go:247] Caches are synced for resource quota

	I1203 02:42:19.598469       1 shared_informer.go:247] Caches are synced for PVC protection

	I1203 02:42:19.598487       1 shared_informer.go:247] Caches are synced for deployment

	I1203 02:42:19.598941       1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.605085       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.623094       1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.629084       1 shared_informer.go:247] Caches are synced for persistent volume

	I1203 02:42:19.638354       1 shared_informer.go:247] Caches are synced for namespace

	I1203 02:42:19.641965       1 shared_informer.go:247] Caches are synced for service account

	I1203 02:42:19.697287       1 shared_informer.go:247] Caches are synced for attach detach

	I1203 02:42:19.698168       1 shared_informer.go:247] Caches are synced for PV protection

	I1203 02:42:19.698204       1 shared_informer.go:247] Caches are synced for expand

	I1203 02:42:19.723295       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5xmj2"

	I1203 02:42:19.723336       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-n6hkm"

	I1203 02:42:19.723690       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1203 02:42:19.800345       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:19.829969       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-qwmpd"

	I1203 02:42:20.016290       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1203 02:42:20.026075       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:20.097398       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177064       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177104       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1203 02:42:34.546360       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	* ==> kube-proxy [b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf] <==

	* I1203 02:42:20.634200       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1203 02:42:20.634302       1 server_others.go:140] Detected node IP 192.168.49.2

	W1203 02:42:20.634321       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1203 02:42:21.018258       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1203 02:42:21.018308       1 server_others.go:212] Using iptables Proxier.

	I1203 02:42:21.018322       1 server_others.go:219] creating dualStackProxier for iptables.

	W1203 02:42:21.018342       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1203 02:42:21.018662       1 server.go:649] Version: v1.22.4

	I1203 02:42:21.020100       1 config.go:224] Starting endpoint slice config controller

	I1203 02:42:21.020120       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1203 02:42:21.020193       1 config.go:315] Starting service config controller

	I1203 02:42:21.020198       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1203 02:42:21.121119       1 shared_informer.go:247] Caches are synced for service config

	I1203 02:42:21.121195       1 shared_informer.go:247] Caches are synced for endpoint slice config

	* ==> kube-scheduler [377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac] <==

	* W1203 02:42:03.294201       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1203 02:42:03.406171       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1203 02:42:03.406300       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1203 02:42:03.406324       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1203 02:42:03.406344       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1203 02:42:03.407679       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1203 02:42:03.415896       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1203 02:42:03.416427       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.418623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1203 02:42:03.421833       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1203 02:42:03.422567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1203 02:42:03.422726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.422862       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1203 02:42:03.423000       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:03.423347       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423470       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423544       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1203 02:42:03.423558       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:03.423644       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1203 02:42:03.424827       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1203 02:42:04.333813       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:04.364124       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:04.365071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:04.472526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I1203 02:42:04.906826       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:12 UTC. --

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.759016    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.769175    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862569    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-cni-cfg\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862653    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-lib-modules\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862702    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-xtables-lock\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862735    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-lib-modules\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862769    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-xtables-lock\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862848    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-proxy\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862905    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fj6q\" (UniqueName: \"kubernetes.io/projected/368971a0-2c0b-44f2-b66d-3257c9f080f4-kube-api-access-6fj6q\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862938    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt4z\" (UniqueName: \"kubernetes.io/projected/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-api-access-cjt4z\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:21 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:21.617953    1250 kubelet.go:2337] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.825477    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961188    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-config-volume\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961235    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt727\" (UniqueName: \"kubernetes.io/projected/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-kube-api-access-wt727\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155456    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155462    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.524995    1250 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525058    1250 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525083    1250 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.840523    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997439    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/9aa5302f-010c-4351-96c2-b2485180be47-tmp\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997691    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfl2n\" (UniqueName: \"kubernetes.io/projected/9aa5302f-010c-4351-96c2-b2485180be47-kube-api-access-cfl2n\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: kubelet.service: Succeeded.

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8] <==

	* I1203 02:42:51.601493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1203 02:42:51.615295       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1203 02:42:51.615709       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1203 02:42:51.641608       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1203 02:42:51.641868       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

	I1203 02:42:51.643094       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbc908e7-bac3-41f4-ad8a-28a0acbab933", APIVersion:"v1", ResourceVersion:"527", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d became leader

	I1203 02:42:51.742125       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

-- /stdout --

** stderr **

	E1203 02:43:10.253042  669036 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (512.281465ms)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211203024124-532170" apiserver is not running, skipping kubectl commands (state="Paused")

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211203024124-532170

helpers_test.go:236: (dbg) docker inspect pause-20211203024124-532170:

-- stdout --

	        "Id": "2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc",

	        "Created": "2021-12-03T02:41:26.275196666Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 651787,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-03T02:41:27.094995507Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hostname",

	        "HostsPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hosts",

	        "LogPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc-json.log",

	        "Name": "/pause-20211203024124-532170",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211203024124-532170:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20211203024124-532170",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf-init/diff:/var/lib/docker/overlay2/6ac4080541cfeacde0b54b862ed3e8c1497bf3d3f22b73f3dd4ce1f668e19c72/diff:/var/lib/docker/overlay2/3e23ff251c4a4f7c2bc4e503098b4a2c6cc61a1d99b51a599fab585fe722bb1b/diff:/var/lib/docker/overlay2/cc6e93735a0ca1de72f287a78429adcbf52754f7b56e82fd10136b36df126cb7/diff:/var/lib/docker/overlay2/9b91525d2aa18b23a08318fd216cf0dd395530e8ee0971ef4ee837687f222c44/diff:/var/lib/docker/overlay2/afd7645dd1e3de615d5e6b8e38717640c35dd9d0dbad5d79e1e72c29f519e047/diff:/var/lib/docker/overlay2/e42185b4ffd5fd72d5dd3032240c65ebde359f8e05c73af3d0187f32c837a786/diff:/var/lib/docker/overlay2/fc00a8e7d591e187ad76a50b07d8c5a06e15c107d4f840ccea15b68e28da1980/diff:/var/lib/docker/overlay2/a29bf1481ece426838b6a498b3effdf9ff07fce93c547917247a80b257a1fe6a/diff:/var/lib/docker/overlay2/d08861a8de693171af3100608e63638de0eff4ee0ab9dad23a141b63c9fc78ba/diff:/var/lib/docker/overlay2/a810fd

33b8bdb6290817982a645db1f3f53d332f221af803394694d926de6ca1/diff:/var/lib/docker/overlay2/82d5a8bdd562d849d98ab607f16a3a733ccc7b8f078412597b1324d4fadd3be1/diff:/var/lib/docker/overlay2/1a93d862337e75ae7f4350d3b11066c9de4c24aceee76546de610057f617281d/diff:/var/lib/docker/overlay2/016cb2f9bec981cb59ea9c574c581bad8e88da405748168504b409ab365eb79b/diff:/var/lib/docker/overlay2/83e41d3d061b2ae009fb28d0223691d1ec84632e4b835f49eec164d4466dae2d/diff:/var/lib/docker/overlay2/0ce62a53786be1b733f4d9a3f0bb5d6eddb1df23134f5b87286ea0a0cf9fbbf0/diff:/var/lib/docker/overlay2/c13141fe83f4579fcc3d40c499982793faebda827f5ca6cc5534911b1ec393f6/diff:/var/lib/docker/overlay2/55fce7735b2305346d30a554960b07ae732bacdfbc399692dd2506c80daf9877/diff:/var/lib/docker/overlay2/252a160a3b32162d3ff13c40ccc33cabd273340235797ebee736493a1029eda7/diff:/var/lib/docker/overlay2/fce6704ef3f6cc37735e8972372e0f5e0bfbf4af83f5ff6fd027e174c59578e0/diff:/var/lib/docker/overlay2/88c75fcb26b5194e243c651225b00fb638c5ea62eb979d7df5b728df5ef5195a/diff:/var/lib/d

ocker/overlay2/0771e6e29be058dc4b8a5521020f5d66e3e4f0996747baea7cb18371e3545b6b/diff:/var/lib/docker/overlay2/9b15999e93e34bb79fccce68ef9de2dfe1780f1d4c0595f52d15981d7090babb/diff:/var/lib/docker/overlay2/8fd40ec7570ab0690e15c09834e3bc5284b3badf0f5b98cf234cc063d023fbce/diff:/var/lib/docker/overlay2/317d010d230847ac38e52570cb1bf66b55a735ba2fcd26045ca1d928fee269e9/diff:/var/lib/docker/overlay2/9e0744f6558a5e30811c7bc770686bb03018000ec5504f0a7342d648858c6520/diff:/var/lib/docker/overlay2/2b1e4978e05c0bbd41e0db471a4546b47e88d4d07bba062e641ee19252fbe324/diff:/var/lib/docker/overlay2/8a5ad66f897aa93b3a59cb81de4d6f3a4437cdf29b1daaac0470479e0627d353/diff:/var/lib/docker/overlay2/4c73a8fc02a1854c714f156081c2ed75e595e3dde9226820f21ff9353b52fbb7/diff:/var/lib/docker/overlay2/be02751327b17c0e71631c5e6cbea324ca807f35ff112d906955328aabd427d8/diff:/var/lib/docker/overlay2/500480e16cba6dcc737fbaabcd657d62a6d877b3505eec63f1de6e5e3c9dbb92/diff:/var/lib/docker/overlay2/2cd99ae5cfb49d19c25b95ac17d84a6889e691672d6d93a9f066ca8b7c4

5289f/diff:/var/lib/docker/overlay2/bc1787830a034113efe9235ddf0dc8652dfff6e7926a63d839120bbe9ebc0b99/diff:/var/lib/docker/overlay2/44149fe8e3297368fee684058e3d52cef2712454b3145aa883bcb63bbae8542f/diff:/var/lib/docker/overlay2/433b47ea5ada41625d6479daf7944dc706ab5abbcad92f65a32b40a754cbf645/diff:/var/lib/docker/overlay2/77082cd9d165ff33aaddc632231ac2ea8dc30f9073037fc9c3c97f50db12d5b2/diff:/var/lib/docker/overlay2/631d81e1d8b807f0a941170215bfd43566c2823909251d69246f84dc74dff425/diff:/var/lib/docker/overlay2/6eb234f85614a81f5323a7f51a68384027e94afd402c9851374d990371ebf594/diff:/var/lib/docker/overlay2/8c188ae964eaa37da1b63d82bc30f6d81e8a06ee2c1af3f12719f9cf443b6e09/diff:/var/lib/docker/overlay2/86d4eaadf1b0680172d06e3118a53a77440af3c8e5bde8c29bb97e7f94599244/diff:/var/lib/docker/overlay2/78fadeb69e3f7825d1bad64e2e686eff962fc4ed859de8fd0d2b2d30d56510a1/diff",

	                "MergedDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/merged",

	                "UpperDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/diff",

	                "WorkDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20211203024124-532170",

	                "Source": "/var/lib/docker/volumes/pause-20211203024124-532170/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20211203024124-532170",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "name.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c1242b1b033f16bedee595a0280553c95576e94729234572b5dbfcbd58cee8ec",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33286"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33285"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33282"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33284"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33283"

},

	            "SandboxKey": "/var/run/docker/netns/c1242b1b033f",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211203024124-532170": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "2fc356be3f9a"

],

	                    "NetworkID": "da1d0795a7d3bb5f007c696fba96d61b49ce95f6e99122ac37e1226dd45b8f38",

	                    "EndpointID": "59b7bb705dfc9e261679395a707aa0e1863d48a4a93f55f99fdcc3b7f3f19ed3",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (521.608995ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25: (11.577067765s)

helpers_test.go:253: TestPause/serial/Pause logs:

-- stdout --

	* ==> Audit <==

	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | -p                                         | multinode-20211203022621-532170            | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:40 UTC | Fri, 03 Dec 2021 02:36:46 UTC |

	|         | multinode-20211203022621-532170            |                                            |         |         |                               |                               |

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:46 UTC | Fri, 03 Dec 2021 02:38:22 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | --wait=true --preload=false                |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:22 UTC | Fri, 03 Dec 2021 02:38:25 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl pull busybox                |                                            |         |         |                               |                               |

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:25 UTC | Fri, 03 Dec 2021 02:39:08 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=docker           |                                            |         |         |                               |                               |

	|         |  --container-runtime=containerd            |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:08 UTC | Fri, 03 Dec 2021 02:39:09 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl image ls                    |                                            |         |         |                               |                               |

	| delete  | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:09 UTC | Fri, 03 Dec 2021 02:39:12 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:12 UTC | Fri, 03 Dec 2021 02:39:53 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:54 UTC | Fri, 03 Dec 2021 02:39:54 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:40:20 UTC | Fri, 03 Dec 2021 02:40:56 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --schedule 15s                             |                                            |         |         |                               |                               |

	| delete  | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:05 UTC | Fri, 03 Dec 2021 02:41:10 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	| delete  | -p                                         | insufficient-storage-20211203024110-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:17 UTC | Fri, 03 Dec 2021 02:41:24 UTC |

	|         | insufficient-storage-20211203024110-532170 |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:41:32 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --no-kubernetes --driver=docker            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| profile | list                                       | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:33 UTC |

	| profile | list --output=json                         | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:34 UTC |

	| stop    | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:34 UTC | Fri, 03 Dec 2021 02:41:35 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:35 UTC | Fri, 03 Dec 2021 02:41:53 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:53 UTC | Fri, 03 Dec 2021 02:41:59 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| delete  | -p                                         | kubenet-20211203024159-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:00 UTC | Fri, 03 Dec 2021 02:42:00 UTC |

	|         | kubenet-20211203024159-532170              |                                            |         |         |                               |                               |

	| delete  | -p                                         | flannel-20211203024200-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:01 UTC | Fri, 03 Dec 2021 02:42:01 UTC |

	|         | flannel-20211203024200-532170              |                                            |         |         |                               |                               |

	| delete  | -p false-20211203024201-532170             | false-20211203024201-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:02 UTC | Fri, 03 Dec 2021 02:42:02 UTC |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:36 UTC |

	|         | --memory=2048                              |                                            |         |         |                               |                               |

	|         | --install-addons=false                     |                                            |         |         |                               |                               |

	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| start   | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:45 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |

	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:45 UTC | Fri, 03 Dec 2021 02:42:49 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:36 UTC | Fri, 03 Dec 2021 02:42:52 UTC |

	|         | --alsologtostderr                          |                                            |         |         |                               |                               |

	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:59 UTC | Fri, 03 Dec 2021 02:43:12 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:43:05

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:43:05.053241  670481 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:43:05.053349  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053360  670481 out.go:310] Setting ErrFile to fd 2...

	I1203 02:43:05.053366  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053498  670481 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:43:05.053757  670481 out.go:304] Setting JSON to false

	I1203 02:43:05.092504  670481 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":15946,"bootTime":1638483439,"procs":273,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:43:05.092647  670481 start.go:122] virtualization: kvm guest

	I1203 02:43:05.095532  670481 out.go:176] * [stopped-upgrade-20211203024124-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:43:05.097255  670481 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:05.095733  670481 notify.go:174] Checking for updates...

	I1203 02:43:05.098850  670481 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:43:05.100471  670481 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:43:05.101957  670481 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:43:05.102446  670481 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:43:05.105412  670481 out.go:176] * Kubernetes 1.22.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.4

	I1203 02:43:05.105461  670481 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:43:05.165355  670481 docker.go:132] docker version: linux-19.03.15

	I1203 02:43:05.165442  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.259347  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.203811101 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:43:05.259486  670481 docker.go:237] overlay module found

	I1203 02:43:05.261650  670481 out.go:176] * Using the docker driver based on existing profile

	I1203 02:43:05.261677  670481 start.go:280] selected driver: docker

	I1203 02:43:05.261683  670481 start.go:775] validating driver "docker" against &{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:m

inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.261780  670481 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:43:05.261826  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.261849  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.263387  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.264549  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.366635  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.304972308 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W1203 02:43:05.366782  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.366817  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.368741  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.368842  670481 cni.go:93] Creating CNI manager for ""

	I1203 02:43:05.368861  670481 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:05.368874  670481 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368883  670481 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368895  670481 start_flags.go:282] config:

	{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.370782  670481 out.go:176] * Starting control plane node stopped-upgrade-20211203024124-532170 in cluster stopped-upgrade-20211203024124-532170

	I1203 02:43:05.370819  670481 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:43:05.372360  670481 out.go:176] * Pulling base image ...

	I1203 02:43:05.372395  670481 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:05.372503  670481 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon

	W1203 02:43:05.483728  670481 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.20.0-containerd-overlay2-amd64.tar.lz4 status code: 404

	I1203 02:43:05.483888  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:05.483967  670481 cache.go:107] acquiring lock: {Name:mk58b755235faafd792a55ffc678df1b94a68bed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484055  670481 cache.go:107] acquiring lock: {Name:mk52be53a20a12a6477d4b0e8db57a1c19c9d6b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484609  670481 cache.go:107] acquiring lock: {Name:mk7261047b045f5003b0a1499b53e56c4066fef9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484626  670481 cache.go:107] acquiring lock: {Name:mk3f28e99ceac9e8992f0b3b268ec7281c4e72db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484665  670481 cache.go:107] acquiring lock: {Name:mk15948f5fe3546c3f6679e86494b38857a18360 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.483973  670481 cache.go:107] acquiring lock: {Name:mkd85507bf8f9ec9c5c7efbe7e495c72c5a5c6cf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484643  670481 cache.go:107] acquiring lock: {Name:mke6a8256f44fd34328c51d78e752dc7a2edad5e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484757  670481 cache.go:107] acquiring lock: {Name:mke201119b191dfece838cdcc83d982d296b3f34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484901  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 exists

	I1203 02:43:05.484920  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists

	I1203 02:43:05.484932  670481 cache.go:107] acquiring lock: {Name:mk596458ff611e0392f6a3eaa557e2f3e7e8e7a2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484952  670481 cache.go:96] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 902.757µs

	I1203 02:43:05.484975  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists

	I1203 02:43:05.484973  670481 cache.go:80] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded

	I1203 02:43:05.484933  670481 cache.go:96] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7" took 976.746µs

	I1203 02:43:05.484992  670481 cache.go:80] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 succeeded

	I1203 02:43:05.484991  670481 cache.go:96] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 942.364µs

	I1203 02:43:05.484947  670481 cache.go:107] acquiring lock: {Name:mk807a6c3536c72c72f3be8529e05e94b09807ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.485015  670481 cache.go:80] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded

	I1203 02:43:05.485038  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists

	I1203 02:43:05.485053  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I1203 02:43:05.485059  670481 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 1.026757ms

	I1203 02:43:05.485076  670481 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded

	I1203 02:43:05.485074  670481 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.015687ms

	I1203 02:43:05.485091  670481 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I1203 02:43:05.485032  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 exists

	I1203 02:43:05.485106  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists

	I1203 02:43:05.485119  670481 cache.go:96] cache image "docker.io/kubernetesui/dashboard:v2.3.1" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1" took 191.686µs

	I1203 02:43:05.485134  670481 cache.go:80] save to tar file docker.io/kubernetesui/dashboard:v2.3.1 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 succeeded

	I1203 02:43:05.485056  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists

	I1203 02:43:05.485132  670481 cache.go:96] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 495.648µs

	I1203 02:43:05.485145  670481 cache.go:80] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded

	I1203 02:43:05.485160  670481 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 541.414µs

	I1203 02:43:05.485181  670481 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded

	I1203 02:43:05.485238  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists

	I1203 02:43:05.485254  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists

	I1203 02:43:05.485266  670481 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.306673ms

	I1203 02:43:05.485270  670481 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 531.113µs

	I1203 02:43:05.485285  670481 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded

	I1203 02:43:05.485297  670481 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded

	I1203 02:43:05.485305  670481 cache.go:87] Successfully saved all images to host disk.

	I1203 02:43:05.490644  670481 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon, skipping pull

	I1203 02:43:05.490682  670481 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 exists in daemon, skipping load

	I1203 02:43:05.490695  670481 cache.go:206] Successfully downloaded all kic artifacts

	I1203 02:43:05.490725  670481 start.go:313] acquiring machines lock for stopped-upgrade-20211203024124-532170: {Name:mk214bf8f7074c905cdda6d55d9ae0d3cdd88bb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.490784  670481 start.go:317] acquired machines lock for "stopped-upgrade-20211203024124-532170" in 46.889µs

	I1203 02:43:05.490801  670481 start.go:93] Skipping create...Using existing machine configuration

	I1203 02:43:05.490809  670481 fix.go:55] fixHost starting:

	I1203 02:43:05.491017  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:05.543776  670481 fix.go:108] recreateIfNeeded on stopped-upgrade-20211203024124-532170: state=Stopped err=<nil>

	W1203 02:43:05.543831  670481 fix.go:134] unexpected machine state, will restart: <nil>

	I1203 02:43:01.948859  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "dmVyc2lvbiA9IDIKcm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQubW9uaXRvci52MS5jZ3JvdXBzIl0KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgI

CBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzYW5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My4yIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICBkaXNjYXJkX3VucGFja2VkX2xheWVycyA9IHRydWUKICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZ

XMucnVuY10KICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQubWsiCiAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5zZXJ2aWNlLnYxLmRpZmYtc2VydmljZSJdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5nYy52MS5zY2hlZHVsZXIiXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY

2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I1203 02:43:01.966266  668072 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1203 02:43:01.975871  668072 crio.go:138] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1203 02:43:01.975944  668072 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1203 02:43:01.987558  668072 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1203 02:43:01.994631  668072 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1203 02:43:02.088178  668072 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1203 02:43:02.199756  668072 start.go:403] Will wait 60s for socket path /run/containerd/containerd.sock

	I1203 02:43:02.199827  668072 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1203 02:43:02.209378  668072 start.go:424] Will wait 60s for crictl version

	I1203 02:43:02.209447  668072 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:02.242429  668072 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:02Z" level=fatal msg="getting the runtime version failed: rpc error: code = Unknown desc = server is not initialized yet"

	I1203 02:43:05.546133  670481 out.go:176] * Restarting existing docker container for "stopped-upgrade-20211203024124-532170" ...

	I1203 02:43:05.546230  670481 cli_runner.go:115] Run: docker start stopped-upgrade-20211203024124-532170

	I1203 02:43:06.204600  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:06.258790  670481 kic.go:420] container "stopped-upgrade-20211203024124-532170" state is running.

	I1203 02:43:06.259210  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.310989  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:06.311197  670481 machine.go:88] provisioning docker machine ...

	I1203 02:43:06.311219  670481 ubuntu.go:169] provisioning hostname "stopped-upgrade-20211203024124-532170"

	I1203 02:43:06.311260  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.364687  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:06.364915  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:06.364935  670481 main.go:130] libmachine: About to run SSH command:

	sudo hostname stopped-upgrade-20211203024124-532170 && echo "stopped-upgrade-20211203024124-532170" | sudo tee /etc/hostname

	I1203 02:43:06.365539  670481 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53072->127.0.0.1:33318: read: connection reset by peer

	I1203 02:43:09.510602  670481 main.go:130] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-20211203024124-532170

	I1203 02:43:09.510704  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.563359  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:09.563558  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:09.563581  670481 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sstopped-upgrade-20211203024124-532170' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-20211203024124-532170/g' /etc/hosts;

				else

					echo '127.0.1.1 stopped-upgrade-20211203024124-532170' | sudo tee -a /etc/hosts;

fi

fi

	I1203 02:43:09.688295  670481 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I1203 02:43:09.688344  670481 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98

/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube}

	I1203 02:43:09.688368  670481 ubuntu.go:177] setting up certificates

	I1203 02:43:09.688379  670481 provision.go:83] configureAuth start

	I1203 02:43:09.688432  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.738851  670481 provision.go:138] copyHostCerts

	I1203 02:43:09.738917  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem, removing ...

	I1203 02:43:09.738931  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem

	I1203 02:43:09.738989  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem (1082 bytes)

	I1203 02:43:09.739126  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem, removing ...

	I1203 02:43:09.739145  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem

	I1203 02:43:09.739173  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem (1123 bytes)

	I1203 02:43:09.739266  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem, removing ...

	I1203 02:43:09.739280  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem

	I1203 02:43:09.739305  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem (1675 bytes)

	I1203 02:43:09.739379  670481 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-20211203024124-532170 san=[192.168.59.203 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-20211203024124-532170]

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	44ad2903327a4       6e38f40d628db       22 seconds ago       Running             storage-provisioner       0                   9d44abe734bc7

	fa412d0bc64fe       8d147537fb7d1       40 seconds ago       Running             coredns                   0                   989b0a20cd6bf

	9fe05a46928d7       6de166512aa22       52 seconds ago       Running             kindnet-cni               0                   52fd468fab925

	b96a30f689aa8       edeff87e48029       53 seconds ago       Running             kube-proxy                0                   1150dc7540b90

	da77c4c16ea38       0ce02f92d3e43       About a minute ago   Running             kube-controller-manager   0                   75715f0308eb1

	377954dfce779       721ba97f54a65       About a minute ago   Running             kube-scheduler            0                   4b59fc65934a4

	c6bb5925aa26b       0048118155842       About a minute ago   Running             etcd                      0                   26442a09720c6

	7861cc2da74e1       8a5cc299272d9       About a minute ago   Running             kube-apiserver            0                   1a438759f3a6e

	* ==> containerd <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:14 UTC. --

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222703254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222716851Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222726647Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222848435Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222920521Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc00041ffb0 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:true} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugin

ConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223014188Z" level=info msg="Connect containerd service"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223064254Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223824728Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223940610Z" level=info msg="Start subscribing containerd event"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224031243Z" level=info msg="Start recovering state"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224569581Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224644393Z" level=info msg=serving... address=/run/containerd/containerd.sock

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224702180Z" level=info msg="containerd successfully booted in 0.040989s"

	Dec 03 02:42:38 pause-20211203024124-532170 systemd[1]: Started containerd container runtime.

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310686273Z" level=info msg="Start event monitor"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310736093Z" level=info msg="Start snapshots syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310744594Z" level=info msg="Start cni network conf syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310757514Z" level=info msg="Start streaming server"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.156621095Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.186943591Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f pid=2529

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.361766697Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,} returns sandbox id \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.365150740Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.436686048Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.437875321Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.586425386Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\" returns successfully"

	* ==> coredns [fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* ==> dmesg <==

	* [  +1.203764] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev veth344f8041

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff de 19 e6 42 b4 2c 08 06        .........B.,..

	[Dec 3 02:35] cgroup: cgroup2: unknown option "nsdelegate"

	[ +43.145422] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.997001] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethae8775a3

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 09 60 d3 6c 6f 08 06        ........`.lo..

	[Dec 3 02:36] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:38] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc07b7bb4

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 9a 08 d6 d0 27 5c 08 06        ..........'\..

	[Dec 3 02:39] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:40] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth5d5f7a44

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 9e b4 3b e2 7b 9d 08 06        ........;.{...

	[Dec 3 02:41] cgroup: cgroup2: unknown option "nsdelegate"

	[ +14.204723] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.025718] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.991957] cgroup: cgroup2: unknown option "nsdelegate"

	[ +19.678388] cgroup: cgroup2: unknown option "nsdelegate"

	[  +2.060023] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:42] cgroup: cgroup2: unknown option "nsdelegate"

	[ +13.603429] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth170a53a8

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 4a 38 90 3b cc 08 06        .......J8.;...

	[  +9.575101] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethe30be4e2

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa eb 14 cd 69 e4 08 06        ..........i...

	[  +9.369686] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:43] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83] <==

	* {"level":"warn","ts":"2021-12-03T02:42:54.631Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.361717606s","expected-duration":"1s"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.854169973s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4890"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[725459631] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:529; }","duration":"1.854256104s","start":"2021-12-03T02:42:52.998Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[725459631] 'range keys from in-memory index tree'  (duration: 1.854072249s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.582355422s","expected-duration":"100ms","prefix":"","request":"header:<ID:8128009408346100277 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >>","response":"size:16"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:52.998Z","time spent":"1.854314416s","remote":"127.0.0.1:33866","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4914,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[615955715] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"1.188717958s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[615955715] 'read index received'  (duration: 968.013476ms)","trace[615955715] 'applied index is now lower than readState.Index'  (duration: 220.703541ms)"],"step_count":2}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1851729177] transaction","detail":"{read_only:false; response_revision:530; number_of_response:1; }","duration":"1.582656878s","start":"2021-12-03T02:42:53.270Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1851729177] 'compare'  (duration: 1.582261694s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.613711605s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.188840443s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1129"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[43474745] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:530; }","duration":"1.188875717s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[43474745] 'agreement among raft nodes before linearized reading'  (duration: 1.188815061s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1805756956] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:529; }","duration":"1.613993557s","start":"2021-12-03T02:42:53.238Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1805756956] 'range keys from in-memory index tree'  (duration: 1.61359796s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.664Z","time spent":"1.188915825s","remote":"127.0.0.1:33864","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1153,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.238Z","time spent":"1.614050289s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.853Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.270Z","time spent":"1.582731298s","remote":"127.0.0.1:33918","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":598,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >"}

	{"level":"warn","ts":"2021-12-03T02:42:55.362Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:55.862Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.363Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.800Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.939127407s","expected-duration":"1s"}

	{"level":"info","ts":"2021-12-03T02:42:56.800Z","caller":"traceutil/trace.go:171","msg":"trace[121078242] linearizableReadLoop","detail":"{readStateIndex:549; appliedIndex:549; }","duration":"1.939141286s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.800Z","steps":["trace[121078242] 'read index received'  (duration: 1.939133379s)","trace[121078242] 'applied index is now lower than readState.Index'  (duration: 6.677µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.953947612s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/kubernetes\" ","response":"range_response_count:1 size:706"}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.95289822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[634251822] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:531; }","duration":"1.953003147s","start":"2021-12-03T02:42:54.862Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[634251822] 'agreement among raft nodes before linearized reading'  (duration: 1.938259419s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[1182520940] range","detail":"{range_begin:/registry/services/specs/default/kubernetes; range_end:; response_count:1; response_revision:531; }","duration":"1.954019471s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[1182520940] 'agreement among raft nodes before linearized reading'  (duration: 1.93925253s)","trace[1182520940] 'range keys from in-memory index tree'  (duration: 14.649038ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.862Z","time spent":"1.953050451s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.861Z","time spent":"1.954077543s","remote":"127.0.0.1:33880","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":1,"response size":730,"request content":"key:\"/registry/services/specs/default/kubernetes\" "}

	* ==> kernel <==

	*  02:43:24 up  4:26,  0 users,  load average: 8.20, 4.08, 2.19

	Linux pause-20211203024124-532170 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4] <==

	* Trace[1329700100]: ---"About to write a response" 7966ms (02:42:32.807)

	Trace[1329700100]: [7.966737646s] [7.966737646s] END

	I1203 02:42:32.808554       1 trace.go:205] Trace[10124701]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:03c422dd-754f-491f-8b0f-8cda1b614985,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:30.264) (total time: 2543ms):

	Trace[10124701]: ---"About to write a response" 2537ms (02:42:32.801)

	Trace[10124701]: [2.543694862s] [2.543694862s] END

	I1203 02:42:32.811479       1 trace.go:205] Trace[1566228004]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:31.447) (total time: 1363ms):

	Trace[1566228004]: ---"Transaction committed" 1363ms (02:42:32.811)

	Trace[1566228004]: [1.363871215s] [1.363871215s] END

	I1203 02:42:32.811607       1 trace.go:205] Trace[659618151]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:7f82b614-c0f3-45b7-a7e7-fd4d532ee2df,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:31.447) (total time: 1364ms):

	Trace[659618151]: ---"Object stored in database" 1363ms (02:42:32.811)

	Trace[659618151]: [1.364142405s] [1.364142405s] END

	I1203 02:42:54.853636       1 trace.go:205] Trace[921726475]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[921726475]: ---"Transaction committed" 1583ms (02:42:54.853)

	Trace[921726475]: [1.584390803s] [1.584390803s] END

	I1203 02:42:54.853975       1 trace.go:205] Trace[719452703]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:2d516ca3-d159-452f-a840-f129cf10d146,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[719452703]: ---"Object stored in database" 1584ms (02:42:54.853)

	Trace[719452703]: [1.584903164s] [1.584903164s] END

	I1203 02:42:54.854055       1 trace.go:205] Trace[1850500647]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:4359df40-5daa-4a50-bd70-f48390ea66ec,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.663) (total time: 1190ms):

	Trace[1850500647]: ---"About to write a response" 1190ms (02:42:54.853)

	Trace[1850500647]: [1.190501383s] [1.190501383s] END

	I1203 02:42:54.857513       1 trace.go:205] Trace[746149164]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (03-Dec-2021 02:42:52.997) (total time: 1859ms):

	Trace[746149164]: [1.859677903s] [1.859677903s] END

	I1203 02:42:54.858039       1 trace.go:205] Trace[100308926]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:9ee7eb23-38af-4c85-8170-deb854735830,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:52.997) (total time: 1860ms):

	Trace[100308926]: ---"Listing from storage done" 1859ms (02:42:54.857)

	Trace[100308926]: [1.860215353s] [1.860215353s] END

	* ==> kube-controller-manager [da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd] <==

	* I1203 02:42:19.598296       1 shared_informer.go:247] Caches are synced for crt configmap

	I1203 02:42:19.598317       1 shared_informer.go:247] Caches are synced for bootstrap_signer

	I1203 02:42:19.598432       1 shared_informer.go:247] Caches are synced for resource quota

	I1203 02:42:19.598469       1 shared_informer.go:247] Caches are synced for PVC protection

	I1203 02:42:19.598487       1 shared_informer.go:247] Caches are synced for deployment

	I1203 02:42:19.598941       1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.605085       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.623094       1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.629084       1 shared_informer.go:247] Caches are synced for persistent volume

	I1203 02:42:19.638354       1 shared_informer.go:247] Caches are synced for namespace

	I1203 02:42:19.641965       1 shared_informer.go:247] Caches are synced for service account

	I1203 02:42:19.697287       1 shared_informer.go:247] Caches are synced for attach detach

	I1203 02:42:19.698168       1 shared_informer.go:247] Caches are synced for PV protection

	I1203 02:42:19.698204       1 shared_informer.go:247] Caches are synced for expand

	I1203 02:42:19.723295       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5xmj2"

	I1203 02:42:19.723336       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-n6hkm"

	I1203 02:42:19.723690       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1203 02:42:19.800345       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:19.829969       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-qwmpd"

	I1203 02:42:20.016290       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1203 02:42:20.026075       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:20.097398       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177064       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177104       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1203 02:42:34.546360       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	* ==> kube-proxy [b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf] <==

	* I1203 02:42:20.634200       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1203 02:42:20.634302       1 server_others.go:140] Detected node IP 192.168.49.2

	W1203 02:42:20.634321       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1203 02:42:21.018258       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1203 02:42:21.018308       1 server_others.go:212] Using iptables Proxier.

	I1203 02:42:21.018322       1 server_others.go:219] creating dualStackProxier for iptables.

	W1203 02:42:21.018342       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1203 02:42:21.018662       1 server.go:649] Version: v1.22.4

	I1203 02:42:21.020100       1 config.go:224] Starting endpoint slice config controller

	I1203 02:42:21.020120       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1203 02:42:21.020193       1 config.go:315] Starting service config controller

	I1203 02:42:21.020198       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1203 02:42:21.121119       1 shared_informer.go:247] Caches are synced for service config

	I1203 02:42:21.121195       1 shared_informer.go:247] Caches are synced for endpoint slice config

	* ==> kube-scheduler [377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac] <==

	* W1203 02:42:03.294201       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1203 02:42:03.406171       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1203 02:42:03.406300       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1203 02:42:03.406324       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1203 02:42:03.406344       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1203 02:42:03.407679       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1203 02:42:03.415896       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1203 02:42:03.416427       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.418623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1203 02:42:03.421833       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1203 02:42:03.422567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1203 02:42:03.422726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.422862       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1203 02:42:03.423000       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:03.423347       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423470       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423544       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1203 02:42:03.423558       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:03.423644       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1203 02:42:03.424827       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1203 02:42:04.333813       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:04.364124       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:04.365071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:04.472526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I1203 02:42:04.906826       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:24 UTC. --

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.759016    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.769175    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862569    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-cni-cfg\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862653    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-lib-modules\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862702    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-xtables-lock\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862735    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-lib-modules\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862769    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-xtables-lock\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862848    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-proxy\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862905    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fj6q\" (UniqueName: \"kubernetes.io/projected/368971a0-2c0b-44f2-b66d-3257c9f080f4-kube-api-access-6fj6q\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862938    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt4z\" (UniqueName: \"kubernetes.io/projected/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-api-access-cjt4z\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:21 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:21.617953    1250 kubelet.go:2337] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.825477    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961188    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-config-volume\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961235    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt727\" (UniqueName: \"kubernetes.io/projected/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-kube-api-access-wt727\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155456    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155462    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.524995    1250 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525058    1250 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525083    1250 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.840523    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997439    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/9aa5302f-010c-4351-96c2-b2485180be47-tmp\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997691    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfl2n\" (UniqueName: \"kubernetes.io/projected/9aa5302f-010c-4351-96c2-b2485180be47-kube-api-access-cfl2n\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: kubelet.service: Succeeded.

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8] <==

	* I1203 02:42:51.601493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1203 02:42:51.615295       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1203 02:42:51.615709       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1203 02:42:51.641608       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1203 02:42:51.641868       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

	I1203 02:42:51.643094       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbc908e7-bac3-41f4-ad8a-28a0acbab933", APIVersion:"v1", ResourceVersion:"527", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d became leader

	I1203 02:42:51.742125       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

-- /stdout --

** stderr **

	E1203 02:43:24.169778  671866 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (686.054671ms)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211203024124-532170" apiserver is not running, skipping kubectl commands (state="Paused")

--- FAIL: TestPause/serial/Pause (33.33s)

–

TestPause/serial/VerifyStatus (13.28s)

=== RUN   TestPause/serial/VerifyStatus

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p pause-20211203024124-532170 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-20211203024124-532170 --output=json --layout=cluster: exit status 2 (615.436476ms)

-- stdout --

	{"Name":"pause-20211203024124-532170","StatusCode":101,"StatusName":"Pausing","Step":"Pausing","StepDetail":"* Pausing node pause-20211203024124-532170 ...","BinaryVersion":"v1.24.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-20211203024124-532170","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr **

	E1203 02:43:26.083338  674089 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

	E1203 02:43:26.083388  674089 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

	E1203 02:43:26.083413  674089 status.go:602] exit code not found: strconv.Atoi: parsing "": invalid syntax

** /stderr **

pause_test.go:198: incorrect status code: 101

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/VerifyStatus]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211203024124-532170

helpers_test.go:236: (dbg) docker inspect pause-20211203024124-532170:

-- stdout --

	        "Id": "2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc",

	        "Created": "2021-12-03T02:41:26.275196666Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 651787,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-03T02:41:27.094995507Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hostname",

	        "HostsPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hosts",

	        "LogPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc-json.log",

	        "Name": "/pause-20211203024124-532170",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211203024124-532170:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20211203024124-532170",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf-init/diff:/var/lib/docker/overlay2/6ac4080541cfeacde0b54b862ed3e8c1497bf3d3f22b73f3dd4ce1f668e19c72/diff:/var/lib/docker/overlay2/3e23ff251c4a4f7c2bc4e503098b4a2c6cc61a1d99b51a599fab585fe722bb1b/diff:/var/lib/docker/overlay2/cc6e93735a0ca1de72f287a78429adcbf52754f7b56e82fd10136b36df126cb7/diff:/var/lib/docker/overlay2/9b91525d2aa18b23a08318fd216cf0dd395530e8ee0971ef4ee837687f222c44/diff:/var/lib/docker/overlay2/afd7645dd1e3de615d5e6b8e38717640c35dd9d0dbad5d79e1e72c29f519e047/diff:/var/lib/docker/overlay2/e42185b4ffd5fd72d5dd3032240c65ebde359f8e05c73af3d0187f32c837a786/diff:/var/lib/docker/overlay2/fc00a8e7d591e187ad76a50b07d8c5a06e15c107d4f840ccea15b68e28da1980/diff:/var/lib/docker/overlay2/a29bf1481ece426838b6a498b3effdf9ff07fce93c547917247a80b257a1fe6a/diff:/var/lib/docker/overlay2/d08861a8de693171af3100608e63638de0eff4ee0ab9dad23a141b63c9fc78ba/diff:/var/lib/docker/overlay2/a810fd

33b8bdb6290817982a645db1f3f53d332f221af803394694d926de6ca1/diff:/var/lib/docker/overlay2/82d5a8bdd562d849d98ab607f16a3a733ccc7b8f078412597b1324d4fadd3be1/diff:/var/lib/docker/overlay2/1a93d862337e75ae7f4350d3b11066c9de4c24aceee76546de610057f617281d/diff:/var/lib/docker/overlay2/016cb2f9bec981cb59ea9c574c581bad8e88da405748168504b409ab365eb79b/diff:/var/lib/docker/overlay2/83e41d3d061b2ae009fb28d0223691d1ec84632e4b835f49eec164d4466dae2d/diff:/var/lib/docker/overlay2/0ce62a53786be1b733f4d9a3f0bb5d6eddb1df23134f5b87286ea0a0cf9fbbf0/diff:/var/lib/docker/overlay2/c13141fe83f4579fcc3d40c499982793faebda827f5ca6cc5534911b1ec393f6/diff:/var/lib/docker/overlay2/55fce7735b2305346d30a554960b07ae732bacdfbc399692dd2506c80daf9877/diff:/var/lib/docker/overlay2/252a160a3b32162d3ff13c40ccc33cabd273340235797ebee736493a1029eda7/diff:/var/lib/docker/overlay2/fce6704ef3f6cc37735e8972372e0f5e0bfbf4af83f5ff6fd027e174c59578e0/diff:/var/lib/docker/overlay2/88c75fcb26b5194e243c651225b00fb638c5ea62eb979d7df5b728df5ef5195a/diff:/var/lib/d

ocker/overlay2/0771e6e29be058dc4b8a5521020f5d66e3e4f0996747baea7cb18371e3545b6b/diff:/var/lib/docker/overlay2/9b15999e93e34bb79fccce68ef9de2dfe1780f1d4c0595f52d15981d7090babb/diff:/var/lib/docker/overlay2/8fd40ec7570ab0690e15c09834e3bc5284b3badf0f5b98cf234cc063d023fbce/diff:/var/lib/docker/overlay2/317d010d230847ac38e52570cb1bf66b55a735ba2fcd26045ca1d928fee269e9/diff:/var/lib/docker/overlay2/9e0744f6558a5e30811c7bc770686bb03018000ec5504f0a7342d648858c6520/diff:/var/lib/docker/overlay2/2b1e4978e05c0bbd41e0db471a4546b47e88d4d07bba062e641ee19252fbe324/diff:/var/lib/docker/overlay2/8a5ad66f897aa93b3a59cb81de4d6f3a4437cdf29b1daaac0470479e0627d353/diff:/var/lib/docker/overlay2/4c73a8fc02a1854c714f156081c2ed75e595e3dde9226820f21ff9353b52fbb7/diff:/var/lib/docker/overlay2/be02751327b17c0e71631c5e6cbea324ca807f35ff112d906955328aabd427d8/diff:/var/lib/docker/overlay2/500480e16cba6dcc737fbaabcd657d62a6d877b3505eec63f1de6e5e3c9dbb92/diff:/var/lib/docker/overlay2/2cd99ae5cfb49d19c25b95ac17d84a6889e691672d6d93a9f066ca8b7c4

5289f/diff:/var/lib/docker/overlay2/bc1787830a034113efe9235ddf0dc8652dfff6e7926a63d839120bbe9ebc0b99/diff:/var/lib/docker/overlay2/44149fe8e3297368fee684058e3d52cef2712454b3145aa883bcb63bbae8542f/diff:/var/lib/docker/overlay2/433b47ea5ada41625d6479daf7944dc706ab5abbcad92f65a32b40a754cbf645/diff:/var/lib/docker/overlay2/77082cd9d165ff33aaddc632231ac2ea8dc30f9073037fc9c3c97f50db12d5b2/diff:/var/lib/docker/overlay2/631d81e1d8b807f0a941170215bfd43566c2823909251d69246f84dc74dff425/diff:/var/lib/docker/overlay2/6eb234f85614a81f5323a7f51a68384027e94afd402c9851374d990371ebf594/diff:/var/lib/docker/overlay2/8c188ae964eaa37da1b63d82bc30f6d81e8a06ee2c1af3f12719f9cf443b6e09/diff:/var/lib/docker/overlay2/86d4eaadf1b0680172d06e3118a53a77440af3c8e5bde8c29bb97e7f94599244/diff:/var/lib/docker/overlay2/78fadeb69e3f7825d1bad64e2e686eff962fc4ed859de8fd0d2b2d30d56510a1/diff",

	                "MergedDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/merged",

	                "UpperDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/diff",

	                "WorkDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20211203024124-532170",

	                "Source": "/var/lib/docker/volumes/pause-20211203024124-532170/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20211203024124-532170",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "name.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c1242b1b033f16bedee595a0280553c95576e94729234572b5dbfcbd58cee8ec",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33286"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33285"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33282"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33284"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33283"

},

	            "SandboxKey": "/var/run/docker/netns/c1242b1b033f",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211203024124-532170": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "2fc356be3f9a"

],

	                    "NetworkID": "da1d0795a7d3bb5f007c696fba96d61b49ce95f6e99122ac37e1226dd45b8f38",

	                    "EndpointID": "59b7bb705dfc9e261679395a707aa0e1863d48a4a93f55f99fdcc3b7f3f19ed3",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (673.77927ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/VerifyStatus FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/VerifyStatus]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25: (11.361588787s)

helpers_test.go:253: TestPause/serial/VerifyStatus logs:

-- stdout --

	* ==> Audit <==

	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:36:46 UTC | Fri, 03 Dec 2021 02:38:22 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | --wait=true --preload=false                |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.0               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:22 UTC | Fri, 03 Dec 2021 02:38:25 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl pull busybox                |                                            |         |         |                               |                               |

	| start   | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:38:25 UTC | Fri, 03 Dec 2021 02:39:08 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | -v=1 --wait=true --driver=docker           |                                            |         |         |                               |                               |

	|         |  --container-runtime=containerd            |                                            |         |         |                               |                               |

	|         | --kubernetes-version=v1.17.3               |                                            |         |         |                               |                               |

	| ssh     | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:08 UTC | Fri, 03 Dec 2021 02:39:09 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	|         | -- sudo crictl image ls                    |                                            |         |         |                               |                               |

	| delete  | -p                                         | test-preload-20211203023646-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:09 UTC | Fri, 03 Dec 2021 02:39:12 UTC |

	|         | test-preload-20211203023646-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:12 UTC | Fri, 03 Dec 2021 02:39:53 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:54 UTC | Fri, 03 Dec 2021 02:39:54 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:40:20 UTC | Fri, 03 Dec 2021 02:40:56 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --schedule 15s                             |                                            |         |         |                               |                               |

	| delete  | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:05 UTC | Fri, 03 Dec 2021 02:41:10 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	| delete  | -p                                         | insufficient-storage-20211203024110-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:17 UTC | Fri, 03 Dec 2021 02:41:24 UTC |

	|         | insufficient-storage-20211203024110-532170 |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:41:32 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --no-kubernetes --driver=docker            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| profile | list                                       | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:33 UTC |

	| profile | list --output=json                         | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:34 UTC |

	| stop    | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:34 UTC | Fri, 03 Dec 2021 02:41:35 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:35 UTC | Fri, 03 Dec 2021 02:41:53 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:53 UTC | Fri, 03 Dec 2021 02:41:59 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| delete  | -p                                         | kubenet-20211203024159-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:00 UTC | Fri, 03 Dec 2021 02:42:00 UTC |

	|         | kubenet-20211203024159-532170              |                                            |         |         |                               |                               |

	| delete  | -p                                         | flannel-20211203024200-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:01 UTC | Fri, 03 Dec 2021 02:42:01 UTC |

	|         | flannel-20211203024200-532170              |                                            |         |         |                               |                               |

	| delete  | -p false-20211203024201-532170             | false-20211203024201-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:02 UTC | Fri, 03 Dec 2021 02:42:02 UTC |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:36 UTC |

	|         | --memory=2048                              |                                            |         |         |                               |                               |

	|         | --install-addons=false                     |                                            |         |         |                               |                               |

	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| start   | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:45 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |

	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:45 UTC | Fri, 03 Dec 2021 02:42:49 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:36 UTC | Fri, 03 Dec 2021 02:42:52 UTC |

	|         | --alsologtostderr                          |                                            |         |         |                               |                               |

	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:59 UTC | Fri, 03 Dec 2021 02:43:12 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:13 UTC | Fri, 03 Dec 2021 02:43:24 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:43:05

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:43:05.053241  670481 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:43:05.053349  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053360  670481 out.go:310] Setting ErrFile to fd 2...

	I1203 02:43:05.053366  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053498  670481 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:43:05.053757  670481 out.go:304] Setting JSON to false

	I1203 02:43:05.092504  670481 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":15946,"bootTime":1638483439,"procs":273,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:43:05.092647  670481 start.go:122] virtualization: kvm guest

	I1203 02:43:05.095532  670481 out.go:176] * [stopped-upgrade-20211203024124-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:43:05.097255  670481 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:05.095733  670481 notify.go:174] Checking for updates...

	I1203 02:43:05.098850  670481 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:43:05.100471  670481 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:43:05.101957  670481 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:43:05.102446  670481 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:43:05.105412  670481 out.go:176] * Kubernetes 1.22.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.4

	I1203 02:43:05.105461  670481 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:43:05.165355  670481 docker.go:132] docker version: linux-19.03.15

	I1203 02:43:05.165442  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.259347  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.203811101 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:43:05.259486  670481 docker.go:237] overlay module found

	I1203 02:43:05.261650  670481 out.go:176] * Using the docker driver based on existing profile

	I1203 02:43:05.261677  670481 start.go:280] selected driver: docker

	I1203 02:43:05.261683  670481 start.go:775] validating driver "docker" against &{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:m

inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.261780  670481 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:43:05.261826  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.261849  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.263387  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.264549  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.366635  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.304972308 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W1203 02:43:05.366782  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.366817  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.368741  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.368842  670481 cni.go:93] Creating CNI manager for ""

	I1203 02:43:05.368861  670481 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:05.368874  670481 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368883  670481 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368895  670481 start_flags.go:282] config:

	{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.370782  670481 out.go:176] * Starting control plane node stopped-upgrade-20211203024124-532170 in cluster stopped-upgrade-20211203024124-532170

	I1203 02:43:05.370819  670481 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:43:05.372360  670481 out.go:176] * Pulling base image ...

	I1203 02:43:05.372395  670481 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:05.372503  670481 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon

	W1203 02:43:05.483728  670481 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.20.0-containerd-overlay2-amd64.tar.lz4 status code: 404

	I1203 02:43:05.483888  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:05.483967  670481 cache.go:107] acquiring lock: {Name:mk58b755235faafd792a55ffc678df1b94a68bed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484055  670481 cache.go:107] acquiring lock: {Name:mk52be53a20a12a6477d4b0e8db57a1c19c9d6b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484609  670481 cache.go:107] acquiring lock: {Name:mk7261047b045f5003b0a1499b53e56c4066fef9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484626  670481 cache.go:107] acquiring lock: {Name:mk3f28e99ceac9e8992f0b3b268ec7281c4e72db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484665  670481 cache.go:107] acquiring lock: {Name:mk15948f5fe3546c3f6679e86494b38857a18360 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.483973  670481 cache.go:107] acquiring lock: {Name:mkd85507bf8f9ec9c5c7efbe7e495c72c5a5c6cf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484643  670481 cache.go:107] acquiring lock: {Name:mke6a8256f44fd34328c51d78e752dc7a2edad5e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484757  670481 cache.go:107] acquiring lock: {Name:mke201119b191dfece838cdcc83d982d296b3f34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484901  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 exists

	I1203 02:43:05.484920  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists

	I1203 02:43:05.484932  670481 cache.go:107] acquiring lock: {Name:mk596458ff611e0392f6a3eaa557e2f3e7e8e7a2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484952  670481 cache.go:96] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 902.757µs

	I1203 02:43:05.484975  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists

	I1203 02:43:05.484973  670481 cache.go:80] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded

	I1203 02:43:05.484933  670481 cache.go:96] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7" took 976.746µs

	I1203 02:43:05.484992  670481 cache.go:80] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 succeeded

	I1203 02:43:05.484991  670481 cache.go:96] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 942.364µs

	I1203 02:43:05.484947  670481 cache.go:107] acquiring lock: {Name:mk807a6c3536c72c72f3be8529e05e94b09807ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.485015  670481 cache.go:80] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded

	I1203 02:43:05.485038  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists

	I1203 02:43:05.485053  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I1203 02:43:05.485059  670481 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 1.026757ms

	I1203 02:43:05.485076  670481 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded

	I1203 02:43:05.485074  670481 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.015687ms

	I1203 02:43:05.485091  670481 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I1203 02:43:05.485032  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 exists

	I1203 02:43:05.485106  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists

	I1203 02:43:05.485119  670481 cache.go:96] cache image "docker.io/kubernetesui/dashboard:v2.3.1" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1" took 191.686µs

	I1203 02:43:05.485134  670481 cache.go:80] save to tar file docker.io/kubernetesui/dashboard:v2.3.1 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 succeeded

	I1203 02:43:05.485056  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists

	I1203 02:43:05.485132  670481 cache.go:96] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 495.648µs

	I1203 02:43:05.485145  670481 cache.go:80] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded

	I1203 02:43:05.485160  670481 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 541.414µs

	I1203 02:43:05.485181  670481 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded

	I1203 02:43:05.485238  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists

	I1203 02:43:05.485254  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists

	I1203 02:43:05.485266  670481 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.306673ms

	I1203 02:43:05.485270  670481 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 531.113µs

	I1203 02:43:05.485285  670481 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded

	I1203 02:43:05.485297  670481 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded

	I1203 02:43:05.485305  670481 cache.go:87] Successfully saved all images to host disk.

	I1203 02:43:05.490644  670481 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon, skipping pull

	I1203 02:43:05.490682  670481 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 exists in daemon, skipping load

	I1203 02:43:05.490695  670481 cache.go:206] Successfully downloaded all kic artifacts

	I1203 02:43:05.490725  670481 start.go:313] acquiring machines lock for stopped-upgrade-20211203024124-532170: {Name:mk214bf8f7074c905cdda6d55d9ae0d3cdd88bb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.490784  670481 start.go:317] acquired machines lock for "stopped-upgrade-20211203024124-532170" in 46.889µs

	I1203 02:43:05.490801  670481 start.go:93] Skipping create...Using existing machine configuration

	I1203 02:43:05.490809  670481 fix.go:55] fixHost starting:

	I1203 02:43:05.491017  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:05.543776  670481 fix.go:108] recreateIfNeeded on stopped-upgrade-20211203024124-532170: state=Stopped err=<nil>

	W1203 02:43:05.543831  670481 fix.go:134] unexpected machine state, will restart: <nil>

	I1203 02:43:01.948859  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "dmVyc2lvbiA9IDIKcm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQubW9uaXRvci52MS5jZ3JvdXBzIl0KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgI

CBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzYW5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My4yIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICBkaXNjYXJkX3VucGFja2VkX2xheWVycyA9IHRydWUKICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZ

XMucnVuY10KICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQubWsiCiAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5zZXJ2aWNlLnYxLmRpZmYtc2VydmljZSJdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5nYy52MS5zY2hlZHVsZXIiXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY

2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I1203 02:43:01.966266  668072 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1203 02:43:01.975871  668072 crio.go:138] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1203 02:43:01.975944  668072 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1203 02:43:01.987558  668072 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1203 02:43:01.994631  668072 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1203 02:43:02.088178  668072 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1203 02:43:02.199756  668072 start.go:403] Will wait 60s for socket path /run/containerd/containerd.sock

	I1203 02:43:02.199827  668072 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1203 02:43:02.209378  668072 start.go:424] Will wait 60s for crictl version

	I1203 02:43:02.209447  668072 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:02.242429  668072 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:02Z" level=fatal msg="getting the runtime version failed: rpc error: code = Unknown desc = server is not initialized yet"

	I1203 02:43:05.546133  670481 out.go:176] * Restarting existing docker container for "stopped-upgrade-20211203024124-532170" ...

	I1203 02:43:05.546230  670481 cli_runner.go:115] Run: docker start stopped-upgrade-20211203024124-532170

	I1203 02:43:06.204600  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:06.258790  670481 kic.go:420] container "stopped-upgrade-20211203024124-532170" state is running.

	I1203 02:43:06.259210  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.310989  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:06.311197  670481 machine.go:88] provisioning docker machine ...

	I1203 02:43:06.311219  670481 ubuntu.go:169] provisioning hostname "stopped-upgrade-20211203024124-532170"

	I1203 02:43:06.311260  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.364687  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:06.364915  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:06.364935  670481 main.go:130] libmachine: About to run SSH command:

	sudo hostname stopped-upgrade-20211203024124-532170 && echo "stopped-upgrade-20211203024124-532170" | sudo tee /etc/hostname

	I1203 02:43:06.365539  670481 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53072->127.0.0.1:33318: read: connection reset by peer

	I1203 02:43:09.510602  670481 main.go:130] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-20211203024124-532170

	I1203 02:43:09.510704  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.563359  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:09.563558  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:09.563581  670481 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sstopped-upgrade-20211203024124-532170' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-20211203024124-532170/g' /etc/hosts;

				else

					echo '127.0.1.1 stopped-upgrade-20211203024124-532170' | sudo tee -a /etc/hosts;

fi

fi

	I1203 02:43:09.688295  670481 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I1203 02:43:09.688344  670481 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98

/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube}

	I1203 02:43:09.688368  670481 ubuntu.go:177] setting up certificates

	I1203 02:43:09.688379  670481 provision.go:83] configureAuth start

	I1203 02:43:09.688432  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.738851  670481 provision.go:138] copyHostCerts

	I1203 02:43:09.738917  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem, removing ...

	I1203 02:43:09.738931  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem

	I1203 02:43:09.738989  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem (1082 bytes)

	I1203 02:43:09.739126  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem, removing ...

	I1203 02:43:09.739145  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem

	I1203 02:43:09.739173  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem (1123 bytes)

	I1203 02:43:09.739266  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem, removing ...

	I1203 02:43:09.739280  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem

	I1203 02:43:09.739305  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem (1675 bytes)

	I1203 02:43:09.739379  670481 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-20211203024124-532170 san=[192.168.59.203 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-20211203024124-532170]

	I1203 02:43:13.374906  666582 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:13.408492  666582 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.9

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:13.408566  666582 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.442414  666582 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.289658  668072 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:13.310235  668072 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.3

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:13.310308  668072 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.405019  668072 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.469787  666582 out.go:176] * Preparing Kubernetes v1.22.4 on containerd 1.4.9 ...

	I1203 02:43:13.469888  666582 cli_runner.go:115] Run: docker network inspect force-systemd-env-20211203024249-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:13.533845  666582 ssh_runner.go:195] Run: grep 192.168.58.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:13.537934  666582 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.58.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:13.550216  666582 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:43:13.550271  666582 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.575367  666582 containerd.go:635] all images are preloaded for containerd runtime.

	I1203 02:43:13.575390  666582 containerd.go:539] Images already preloaded, skipping extraction

	I1203 02:43:13.575437  666582 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.604322  666582 containerd.go:635] all images are preloaded for containerd runtime.

	I1203 02:43:13.604344  666582 cache_images.go:79] Images are preloaded, skipping loading

	I1203 02:43:13.604392  666582 ssh_runner.go:195] Run: sudo crictl info

	I1203 02:43:13.655453  666582 cni.go:93] Creating CNI manager for ""

	I1203 02:43:13.655480  666582 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:13.655495  666582 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1203 02:43:13.655517  666582 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.22.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:force-systemd-env-20211203024249-532170 NodeName:force-systemd-env-20211203024249-532170 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:

cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1203 02:43:13.655684  666582 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.58.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "force-systemd-env-20211203024249-532170"

	  kubeletExtraArgs:

	    node-ip: 192.168.58.2

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.4

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1203 02:43:13.655804  666582 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=force-systemd-env-20211203024249-532170 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.58.2 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.22.4 ClusterName:force-systemd-env-20211203024249-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1203 02:43:13.655876  666582 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.22.4

	I1203 02:43:13.665340  666582 binaries.go:44] Found k8s binaries, skipping transfer

	I1203 02:43:13.665395  666582 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1203 02:43:13.672776  666582 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (584 bytes)

	I1203 02:43:13.689078  666582 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1203 02:43:13.715673  666582 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2089 bytes)

	I1203 02:43:13.732847  666582 ssh_runner.go:195] Run: grep 192.168.58.2	control-plane.minikube.internal$ /etc/hosts

	I1203 02:43:13.738503  666582 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:13.757579  666582 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170 for IP: 192.168.58.2

	I1203 02:43:13.757691  666582 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key

	I1203 02:43:13.757737  666582 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key

	I1203 02:43:13.757790  666582 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key

	I1203 02:43:13.757806  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt with IP's: []

	I1203 02:43:14.006280  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt ...

	I1203 02:43:14.006314  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt: {Name:mk4d4683ea8e9216367aac396745b0fc9b1afedf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.006538  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key ...

	I1203 02:43:14.006581  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key: {Name:mkcdaf5c481e4af436b24db927f1528e9f05c1e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.006736  666582 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041

	I1203 02:43:14.006777  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1203 02:43:10.207230  670481 provision.go:172] copyRemoteCerts

	I1203 02:43:11.691868  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1203 02:43:11.691914  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:11.740869  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:11.837960  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1203 02:43:11.859873  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1203 02:43:11.878401  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)

	I1203 02:43:11.896156  670481 provision.go:86] duration metric: configureAuth took 2.207759125s

	I1203 02:43:11.896187  670481 ubuntu.go:193] setting minikube options for container-runtime

	I1203 02:43:11.896407  670481 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:43:11.896425  670481 machine.go:91] provisioned docker machine in 5.585215428s

	I1203 02:43:11.896434  670481 start.go:267] post-start starting for "stopped-upgrade-20211203024124-532170" (driver="docker")

	I1203 02:43:11.896527  670481 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1203 02:43:11.896592  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1203 02:43:11.896638  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:11.948335  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.043755  670481 ssh_runner.go:195] Run: cat /etc/os-release

	I1203 02:43:12.046665  670481 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1203 02:43:12.046686  670481 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1203 02:43:12.046694  670481 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1203 02:43:12.046700  670481 info.go:137] Remote host: Ubuntu 20.04.1 LTS

	I1203 02:43:12.046708  670481 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/addons for local assets ...

	I1203 02:43:12.046749  670481 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files for local assets ...

	I1203 02:43:12.046833  670481 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem -> 5321702.pem in /etc/ssl/certs

	I1203 02:43:12.046922  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1203 02:43:12.053847  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:12.070286  670481 start.go:270] post-start completed in 173.83646ms

	I1203 02:43:12.070354  670481 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1203 02:43:12.070391  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.134886  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.230726  670481 fix.go:57] fixHost completed within 6.739910273s

	I1203 02:43:12.230752  670481 start.go:80] releasing machines lock for "stopped-upgrade-20211203024124-532170", held for 6.739957389s

	I1203 02:43:12.230833  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.274590  670481 ssh_runner.go:195] Run: systemctl --version

	I1203 02:43:12.274645  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.274646  670481 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1203 02:43:12.274705  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.331772  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.355499  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.421732  670481 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1203 02:43:12.456318  670481 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1203 02:43:12.469209  670481 docker.go:156] disabling docker service ...

	I1203 02:43:12.469256  670481 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1203 02:43:12.486072  670481 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1203 02:43:12.501409  670481 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1203 02:43:12.594277  670481 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1203 02:43:12.677996  670481 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1203 02:43:12.688263  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1203 02:43:12.704388  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "dmVyc2lvbiA9IDIKcm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQubW9uaXRvci52MS5jZ3JvdXBzIl0KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgI

CBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzYW5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My4yIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICBkaXNjYXJkX3VucGFja2VkX2xheWVycyA9IHRydWUKICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZ

XMucnVuY10KICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQubWsiCiAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5zZXJ2aWNlLnYxLmRpZmYtc2VydmljZSJdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5nYy52MS5zY2hlZHVsZXIiXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY

2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I1203 02:43:12.725626  670481 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1203 02:43:12.733897  670481 crio.go:138] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1203 02:43:12.733956  670481 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1203 02:43:12.742780  670481 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1203 02:43:12.750995  670481 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1203 02:43:12.820652  670481 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1203 02:43:12.909892  670481 start.go:403] Will wait 60s for socket path /run/containerd/containerd.sock

	I1203 02:43:12.909979  670481 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1203 02:43:12.915017  670481 start.go:424] Will wait 60s for crictl version

	I1203 02:43:12.915078  670481 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:12.933600  670481 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:12Z" level=fatal msg="getting the runtime version failed: rpc error: code = Unknown desc = server is not initialized yet"

	I1203 02:43:13.507390  668072 out.go:176] * Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...

	I1203 02:43:13.507493  668072 cli_runner.go:115] Run: docker network inspect running-upgrade-20211203024210-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:13.561588  668072 ssh_runner.go:195] Run: grep 192.168.70.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:13.596504  668072 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:13.596566  668072 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.629395  668072 containerd.go:631] couldn't find preloaded image for "gcr.io/k8s-minikube/storage-provisioner:v5". assuming images are not preloaded.

	I1203 02:43:13.629422  668072 cache_images.go:83] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.20.0 k8s.gcr.io/kube-controller-manager:v1.20.0 k8s.gcr.io/kube-scheduler:v1.20.0 k8s.gcr.io/kube-proxy:v1.20.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1203 02:43:13.629489  668072 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:13.629708  668072 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:13.629821  668072 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:13.629922  668072 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:13.630044  668072 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:13.630147  668072 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1203 02:43:13.630256  668072 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:13.630356  668072 image.go:134] retrieving image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:13.630449  668072 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:13.630543  668072 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:13.631465  668072 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636690  668072 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636645  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.646552  668072 image.go:176] found k8s.gcr.io/pause:3.2 locally: &{UncompressedImageCore:0xc0005e03d0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:13.646605  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2"

	I1203 02:43:14.018537  668072 image.go:176] found gcr.io/k8s-minikube/storage-provisioner:v5 locally: &{UncompressedImageCore:0xc0005e02f0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:14.018603  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"

	I1203 02:43:14.053729  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0"

	I1203 02:43:14.127310  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0"

	I1203 02:43:14.133349  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0"

	I1203 02:43:14.133402  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0"

	I1203 02:43:14.199370  668072 image.go:176] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc0005e02b0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:14.199456  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0"

	I1203 02:43:14.295526  668072 cache_images.go:111] "k8s.gcr.io/pause:3.2" needs transfer: "k8s.gcr.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1203 02:43:14.295593  668072 cri.go:204] Removing image: k8s.gcr.io/pause:3.2

	I1203 02:43:14.295641  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:14.708121  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7"

	I1203 02:43:14.715519  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1"

	I1203 02:43:15.220915  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5": (1.202291307s)

	I1203 02:43:15.220971  668072 cache_images.go:111] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1203 02:43:15.221007  668072 cri.go:204] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:15.221050  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.437917  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0": (1.384141462s)

	I1203 02:43:15.437978  668072 cache_images.go:111] "k8s.gcr.io/kube-scheduler:v1.20.0" needs transfer: "k8s.gcr.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I1203 02:43:15.438017  668072 cri.go:204] Removing image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:15.438075  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.438205  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0": (1.310871764s)

	I1203 02:43:15.438232  668072 cache_images.go:111] "k8s.gcr.io/kube-apiserver:v1.20.0" needs transfer: "k8s.gcr.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I1203 02:43:15.438253  668072 cri.go:204] Removing image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:15.438296  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.512871  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0": (1.379433065s)

	I1203 02:43:15.512925  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0": (1.379532975s)

	I1203 02:43:15.512978  668072 cache_images.go:111] "k8s.gcr.io/kube-proxy:v1.20.0" needs transfer: "k8s.gcr.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I1203 02:43:15.513068  668072 cache_images.go:111] "k8s.gcr.io/kube-controller-manager:v1.20.0" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I1203 02:43:15.513101  668072 cri.go:204] Removing image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:15.513101  668072 cri.go:204] Removing image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:15.513148  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.513148  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.533241  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0": (1.333758933s)

	I1203 02:43:15.533285  668072 cache_images.go:111] "k8s.gcr.io/coredns:1.7.0" needs transfer: "k8s.gcr.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime

	I1203 02:43:15.533311  668072 cri.go:204] Removing image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:15.533362  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.533440  668072 ssh_runner.go:235] Completed: which crictl: (1.237786727s)

	I1203 02:43:15.533478  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.2

	I1203 02:43:15.738687  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7": (1.030489113s)

	I1203 02:43:15.738780  668072 cache_images.go:111] "docker.io/kubernetesui/metrics-scraper:v1.0.7" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.7" does not exist at hash "7801cfc6d5c072eb114355d369c830641064a246b5a774bcd668fac75ec728e9" in container runtime

	I1203 02:43:15.738833  668072 cri.go:204] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:15.738894  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.747701  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1": (1.03213955s)

	I1203 02:43:15.747763  668072 cache_images.go:111] "docker.io/kubernetesui/dashboard:v2.3.1" needs transfer: "docker.io/kubernetesui/dashboard:v2.3.1" does not exist at hash "e1482a24335a6e76d438ae175f79409004588570d3e5dbb4c8140e025e848570" in container runtime

	I1203 02:43:15.747795  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:15.747800  668072 cri.go:204] Removing image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:15.747840  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.747924  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:15.747947  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:15.747948  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:15.748010  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:15.748088  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns:1.7.0

	I1203 02:43:15.748119  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I1203 02:43:15.748176  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2

	I1203 02:43:15.748182  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:15.912060  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7

	I1203 02:43:15.912163  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:15.994060  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/pause_3.2': No such file or directory

	I1203 02:43:15.994173  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 --> /var/lib/minikube/images/pause_3.2 (325632 bytes)

	I1203 02:43:15.994313  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0

	I1203 02:43:15.994418  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:15.994472  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0

	I1203 02:43:15.994536  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:15.994588  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0

	I1203 02:43:15.994646  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:15.994709  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0

	I1203 02:43:15.994763  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:15.994820  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0

	I1203 02:43:15.994872  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:15.994929  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:15.995075  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5

	I1203 02:43:15.995137  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:15.995217  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.7': No such file or directory

	I1203 02:43:15.995235  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 --> /var/lib/minikube/images/metrics-scraper_v1.0.7 (15031296 bytes)

	W1203 02:43:15.995725  668072 ssh_runner.go:129] session error, resetting client: ssh: rejected: connect failed (open failed)

	I1203 02:43:15.995765  668072 retry.go:31] will retry after 360.127272ms: ssh: rejected: connect failed (open failed)

	I1203 02:43:16.022326  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_1.7.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/coredns_1.7.0': No such file or directory

	I1203 02:43:16.022377  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 --> /var/lib/minikube/images/coredns_1.7.0 (16093184 bytes)

	I1203 02:43:16.022448  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.022807  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.20.0': No such file or directory

	I1203 02:43:16.022837  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 --> /var/lib/minikube/images/kube-scheduler_v1.20.0 (14016512 bytes)

	I1203 02:43:16.022889  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.022934  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I1203 02:43:16.022968  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)

	I1203 02:43:16.023048  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023072  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.20.0': No such file or directory

	I1203 02:43:16.023089  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 --> /var/lib/minikube/images/kube-proxy_v1.20.0 (49545216 bytes)

	I1203 02:43:16.023131  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023255  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.20.0': No such file or directory

	I1203 02:43:16.023272  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 --> /var/lib/minikube/images/kube-controller-manager_v1.20.0 (29364736 bytes)

	I1203 02:43:16.023284  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.20.0': No such file or directory

	I1203 02:43:16.023300  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 --> /var/lib/minikube/images/kube-apiserver_v1.20.0 (30411776 bytes)

	I1203 02:43:16.023321  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023340  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023464  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1

	I1203 02:43:16.025608  668072 containerd.go:305] Loading image: /var/lib/minikube/images/pause_3.2

	I1203 02:43:16.025757  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2

	I1203 02:43:16.026007  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.056743  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:16.056855  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.088921  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.146964  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.159619  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.184605  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.197368  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.202942  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.213310  668072 image.go:176] found k8s.gcr.io/etcd:3.4.13-0 locally: &{UncompressedImageCore:0xc0006301c8 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:16.213442  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.4.13-0"

	I1203 02:43:16.220811  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.224601  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:14.127535  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 ...

	I1203 02:43:14.127592  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041: {Name:mk5f47ffc475df8c0a3bcf3c0c1a5cf5174d8b6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.127827  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041 ...

	I1203 02:43:14.127848  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041: {Name:mk8f4915f53e586d73e0361bd23da7153fa96e23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.128011  666582 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt

	I1203 02:43:14.128096  666582 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key

	I1203 02:43:14.128162  666582 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key

	I1203 02:43:14.128180  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt with IP's: []

	I1203 02:43:14.391319  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt ...

	I1203 02:43:14.391356  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt: {Name:mk87aaeb21870cb50c3d16b4298c870928863653 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.391572  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key ...

	I1203 02:43:14.391591  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key: {Name:mkfe63eb61a3e464bc7c356ef4ff494653fc552d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.391709  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1203 02:43:14.391735  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1203 02:43:14.391751  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1203 02:43:14.391769  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1203 02:43:14.391785  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1203 02:43:14.391805  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1203 02:43:14.391820  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1203 02:43:14.391833  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1203 02:43:14.391895  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem (1338 bytes)

	W1203 02:43:14.391945  666582 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170_empty.pem, impossibly tiny 0 bytes

	I1203 02:43:14.391964  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem (1675 bytes)

	I1203 02:43:14.391997  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem (1082 bytes)

	I1203 02:43:14.392029  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem (1123 bytes)

	I1203 02:43:14.392068  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem (1675 bytes)

	I1203 02:43:14.392129  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:14.392166  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.392182  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem -> /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.392198  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem -> /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.393532  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1203 02:43:14.419883  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1203 02:43:14.442015  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1203 02:43:14.461307  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1203 02:43:14.479011  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1203 02:43:14.497470  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1203 02:43:14.522748  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1203 02:43:14.545105  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1203 02:43:14.563414  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1203 02:43:14.581826  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem --> /usr/share/ca-certificates/532170.pem (1338 bytes)

	I1203 02:43:14.601502  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /usr/share/ca-certificates/5321702.pem (1708 bytes)

	I1203 02:43:14.626333  666582 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1203 02:43:14.641210  666582 ssh_runner.go:195] Run: openssl version

	I1203 02:43:14.646475  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5321702.pem && ln -fs /usr/share/ca-certificates/5321702.pem /etc/ssl/certs/5321702.pem"

	I1203 02:43:14.655094  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.658559  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec  3 02:15 /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.658610  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.663759  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5321702.pem /etc/ssl/certs/3ec20f2e.0"

	I1203 02:43:14.672151  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1203 02:43:14.681066  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.684273  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec  3 02:10 /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.684320  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.689352  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1203 02:43:14.698464  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/532170.pem && ln -fs /usr/share/ca-certificates/532170.pem /etc/ssl/certs/532170.pem"

	I1203 02:43:14.708549  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.716574  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec  3 02:15 /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.716632  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.723822  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/532170.pem /etc/ssl/certs/51391683.0"

	I1203 02:43:14.733783  666582 kubeadm.go:390] StartCluster: {Name:force-systemd-env-20211203024249-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:force-systemd-env-20211203024249-532170 Namespace:default APIServerName:minikubeCA APIServerNa

mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:43:14.733907  666582 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1203 02:43:14.733976  666582 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:14.760633  666582 cri.go:76] found id: ""

	I1203 02:43:14.760706  666582 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1203 02:43:14.768226  666582 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:14.775474  666582 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver

	I1203 02:43:14.775525  666582 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1203 02:43:14.782676  666582 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1203 02:43:14.782720  666582 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1203 02:43:17.013120  668072 cache_images.go:111] "k8s.gcr.io/etcd:3.4.13-0" needs transfer: "k8s.gcr.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime

	I1203 02:43:17.013177  668072 cri.go:204] Removing image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:17.013232  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:17.305829  668072 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: (1.249046831s)

	I1203 02:43:17.305882  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/dashboard_v2.3.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.3.1': No such file or directory

	I1203 02:43:17.305914  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 --> /var/lib/minikube/images/dashboard_v2.3.1 (66936320 bytes)

	I1203 02:43:17.306031  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2: (1.28015886s)

	I1203 02:43:17.306057  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 from cache

	I1203 02:43:17.306087  668072 containerd.go:305] Loading image: /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:17.306143  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:17.306263  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:19.131829  668072 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0: (1.825528631s)

	I1203 02:43:19.131859  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0: (1.825687546s)

	I1203 02:43:19.131869  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0

	I1203 02:43:19.131884  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 from cache

	I1203 02:43:19.131908  668072 containerd.go:305] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:19.131954  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:19.131964  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:20.036231  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache

	I1203 02:43:20.036236  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.4.13-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/etcd_3.4.13-0': No such file or directory

	I1203 02:43:20.036272  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:20.036286  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 --> /var/lib/minikube/images/etcd_3.4.13-0 (98416128 bytes)

	I1203 02:43:20.036325  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:20.803180  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 from cache

	I1203 02:43:20.803218  668072 containerd.go:305] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:20.803257  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:23.980570  670481 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:23.994908  670481 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.3

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:23.994974  670481 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:24.025450  670481 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:24.056378  670481 out.go:176] * Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...

	I1203 02:43:24.056512  670481 cli_runner.go:115] Run: docker network inspect stopped-upgrade-20211203024124-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:24.096031  670481 ssh_runner.go:195] Run: grep 192.168.59.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:24.100345  670481 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.59.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:24.111886  670481 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:24.111937  670481 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:24.128575  670481 containerd.go:631] couldn't find preloaded image for "gcr.io/k8s-minikube/storage-provisioner:v5". assuming images are not preloaded.

	I1203 02:43:24.128608  670481 cache_images.go:83] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.20.0 k8s.gcr.io/kube-controller-manager:v1.20.0 k8s.gcr.io/kube-scheduler:v1.20.0 k8s.gcr.io/kube-proxy:v1.20.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1203 02:43:24.128684  670481 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:24.128897  670481 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:24.128920  670481 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1203 02:43:24.128996  670481 image.go:134] retrieving image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:24.129092  670481 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:24.129116  670481 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:24.129183  670481 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:24.129241  670481 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:24.129283  670481 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:24.129373  670481 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:24.132942  670481 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1203 02:43:24.136775  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141359  670481 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1203 02:43:24.141562  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141745  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141897  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.146071  670481 image.go:176] found k8s.gcr.io/pause:3.2 locally: &{UncompressedImageCore:0xc000652438 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.146128  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2"

	I1203 02:43:24.315253  670481 cache_images.go:111] "k8s.gcr.io/pause:3.2" needs transfer: "k8s.gcr.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1203 02:43:24.315304  670481 cri.go:204] Removing image: k8s.gcr.io/pause:3.2

	I1203 02:43:24.315348  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.319331  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.2

	I1203 02:43:24.358255  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I1203 02:43:24.358356  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.362335  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/pause_3.2 (exists)

	I1203 02:43:24.362360  670481 containerd.go:305] Loading image: /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.362401  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.548439  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0"

	I1203 02:43:24.549018  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0"

	I1203 02:43:24.554962  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0"

	I1203 02:43:24.575504  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 from cache

	I1203 02:43:24.591874  670481 image.go:176] found gcr.io/k8s-minikube/storage-provisioner:v5 locally: &{UncompressedImageCore:0xc00064a108 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.592002  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"

	I1203 02:43:24.659133  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0"

	I1203 02:43:24.758904  670481 image.go:176] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc000010038 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.758973  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0"

	I1203 02:43:24.823666  670481 cache_images.go:111] "k8s.gcr.io/kube-proxy:v1.20.0" needs transfer: "k8s.gcr.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I1203 02:43:24.823718  670481 cri.go:204] Removing image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:24.823767  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.838637  670481 cache_images.go:111] "k8s.gcr.io/kube-controller-manager:v1.20.0" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I1203 02:43:24.838683  670481 cri.go:204] Removing image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:24.838742  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.895572  670481 cache_images.go:111] "k8s.gcr.io/kube-apiserver:v1.20.0" needs transfer: "k8s.gcr.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I1203 02:43:24.895642  670481 cri.go:204] Removing image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:24.895686  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.928776  670481 cache_images.go:111] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1203 02:43:24.928824  670481 cri.go:204] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:24.928878  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.960976  670481 cache_images.go:111] "k8s.gcr.io/kube-scheduler:v1.20.0" needs transfer: "k8s.gcr.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I1203 02:43:24.961032  670481 cri.go:204] Removing image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:24.961071  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:21.916298  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.7: (1.113009595s)

	I1203 02:43:21.916331  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 from cache

	I1203 02:43:21.916376  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:21.916454  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:22.740030  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 from cache

	I1203 02:43:22.740076  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:22.740130  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:23.546417  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 from cache

	I1203 02:43:23.546461  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:23.546510  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:24.996385  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0: (1.449847057s)

	I1203 02:43:24.996413  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 from cache

	I1203 02:43:24.996434  668072 containerd.go:305] Loading image: /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:24.996532  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.3.1

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	44ad2903327a4       6e38f40d628db       36 seconds ago       Running             storage-provisioner       0                   9d44abe734bc7

	fa412d0bc64fe       8d147537fb7d1       54 seconds ago       Running             coredns                   0                   989b0a20cd6bf

	9fe05a46928d7       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   52fd468fab925

	b96a30f689aa8       edeff87e48029       About a minute ago   Running             kube-proxy                0                   1150dc7540b90

	da77c4c16ea38       0ce02f92d3e43       About a minute ago   Running             kube-controller-manager   0                   75715f0308eb1

	377954dfce779       721ba97f54a65       About a minute ago   Running             kube-scheduler            0                   4b59fc65934a4

	c6bb5925aa26b       0048118155842       About a minute ago   Running             etcd                      0                   26442a09720c6

	7861cc2da74e1       8a5cc299272d9       About a minute ago   Running             kube-apiserver            0                   1a438759f3a6e

	* ==> containerd <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:27 UTC. --

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222703254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222716851Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222726647Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222848435Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222920521Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc00041ffb0 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:true} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugin

ConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223014188Z" level=info msg="Connect containerd service"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223064254Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223824728Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223940610Z" level=info msg="Start subscribing containerd event"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224031243Z" level=info msg="Start recovering state"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224569581Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224644393Z" level=info msg=serving... address=/run/containerd/containerd.sock

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224702180Z" level=info msg="containerd successfully booted in 0.040989s"

	Dec 03 02:42:38 pause-20211203024124-532170 systemd[1]: Started containerd container runtime.

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310686273Z" level=info msg="Start event monitor"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310736093Z" level=info msg="Start snapshots syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310744594Z" level=info msg="Start cni network conf syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310757514Z" level=info msg="Start streaming server"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.156621095Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.186943591Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f pid=2529

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.361766697Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,} returns sandbox id \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.365150740Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.436686048Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.437875321Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.586425386Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\" returns successfully"

	* ==> coredns [fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf] <==

	* W1203 02:43:19.553172       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553228       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Namespace ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553214       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	.:53

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* ==> dmesg <==

	* [  +1.203764] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev veth344f8041

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff de 19 e6 42 b4 2c 08 06        .........B.,..

	[Dec 3 02:35] cgroup: cgroup2: unknown option "nsdelegate"

	[ +43.145422] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.997001] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethae8775a3

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 09 60 d3 6c 6f 08 06        ........`.lo..

	[Dec 3 02:36] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:38] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc07b7bb4

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 9a 08 d6 d0 27 5c 08 06        ..........'\..

	[Dec 3 02:39] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:40] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth5d5f7a44

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 9e b4 3b e2 7b 9d 08 06        ........;.{...

	[Dec 3 02:41] cgroup: cgroup2: unknown option "nsdelegate"

	[ +14.204723] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.025718] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.991957] cgroup: cgroup2: unknown option "nsdelegate"

	[ +19.678388] cgroup: cgroup2: unknown option "nsdelegate"

	[  +2.060023] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:42] cgroup: cgroup2: unknown option "nsdelegate"

	[ +13.603429] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth170a53a8

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 4a 38 90 3b cc 08 06        .......J8.;...

	[  +9.575101] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethe30be4e2

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa eb 14 cd 69 e4 08 06        ..........i...

	[  +9.369686] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:43] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83] <==

	* {"level":"warn","ts":"2021-12-03T02:42:54.631Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.361717606s","expected-duration":"1s"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.854169973s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" ","response":"range_response_count:1 size:4890"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[725459631] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:1; response_revision:529; }","duration":"1.854256104s","start":"2021-12-03T02:42:52.998Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[725459631] 'range keys from in-memory index tree'  (duration: 1.854072249s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.582355422s","expected-duration":"100ms","prefix":"","request":"header:<ID:8128009408346100277 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >>","response":"size:16"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:52.998Z","time spent":"1.854314416s","remote":"127.0.0.1:33866","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":1,"response size":4914,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" "}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[615955715] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"1.188717958s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[615955715] 'read index received'  (duration: 968.013476ms)","trace[615955715] 'applied index is now lower than readState.Index'  (duration: 220.703541ms)"],"step_count":2}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1851729177] transaction","detail":"{read_only:false; response_revision:530; number_of_response:1; }","duration":"1.582656878s","start":"2021-12-03T02:42:53.270Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1851729177] 'compare'  (duration: 1.582261694s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.613711605s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.188840443s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1129"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[43474745] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:530; }","duration":"1.188875717s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[43474745] 'agreement among raft nodes before linearized reading'  (duration: 1.188815061s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1805756956] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:529; }","duration":"1.613993557s","start":"2021-12-03T02:42:53.238Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1805756956] 'range keys from in-memory index tree'  (duration: 1.61359796s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.664Z","time spent":"1.188915825s","remote":"127.0.0.1:33864","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1153,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.238Z","time spent":"1.614050289s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.853Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.270Z","time spent":"1.582731298s","remote":"127.0.0.1:33918","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":598,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >"}

	{"level":"warn","ts":"2021-12-03T02:42:55.362Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:55.862Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.363Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.800Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.939127407s","expected-duration":"1s"}

	{"level":"info","ts":"2021-12-03T02:42:56.800Z","caller":"traceutil/trace.go:171","msg":"trace[121078242] linearizableReadLoop","detail":"{readStateIndex:549; appliedIndex:549; }","duration":"1.939141286s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.800Z","steps":["trace[121078242] 'read index received'  (duration: 1.939133379s)","trace[121078242] 'applied index is now lower than readState.Index'  (duration: 6.677µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.953947612s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/kubernetes\" ","response":"range_response_count:1 size:706"}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.95289822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[634251822] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:531; }","duration":"1.953003147s","start":"2021-12-03T02:42:54.862Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[634251822] 'agreement among raft nodes before linearized reading'  (duration: 1.938259419s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[1182520940] range","detail":"{range_begin:/registry/services/specs/default/kubernetes; range_end:; response_count:1; response_revision:531; }","duration":"1.954019471s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[1182520940] 'agreement among raft nodes before linearized reading'  (duration: 1.93925253s)","trace[1182520940] 'range keys from in-memory index tree'  (duration: 14.649038ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.862Z","time spent":"1.953050451s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.861Z","time spent":"1.954077543s","remote":"127.0.0.1:33880","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":1,"response size":730,"request content":"key:\"/registry/services/specs/default/kubernetes\" "}

	* ==> kernel <==

	*  02:43:37 up  4:26,  0 users,  load average: 7.89, 4.22, 2.27

	Linux pause-20211203024124-532170 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4] <==

	* Trace[1329700100]: ---"About to write a response" 7966ms (02:42:32.807)

	Trace[1329700100]: [7.966737646s] [7.966737646s] END

	I1203 02:42:32.808554       1 trace.go:205] Trace[10124701]: "Get" url:/api/v1/namespaces/kube-system/pods/kube-apiserver-pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:03c422dd-754f-491f-8b0f-8cda1b614985,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:30.264) (total time: 2543ms):

	Trace[10124701]: ---"About to write a response" 2537ms (02:42:32.801)

	Trace[10124701]: [2.543694862s] [2.543694862s] END

	I1203 02:42:32.811479       1 trace.go:205] Trace[1566228004]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:31.447) (total time: 1363ms):

	Trace[1566228004]: ---"Transaction committed" 1363ms (02:42:32.811)

	Trace[1566228004]: [1.363871215s] [1.363871215s] END

	I1203 02:42:32.811607       1 trace.go:205] Trace[659618151]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:7f82b614-c0f3-45b7-a7e7-fd4d532ee2df,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:31.447) (total time: 1364ms):

	Trace[659618151]: ---"Object stored in database" 1363ms (02:42:32.811)

	Trace[659618151]: [1.364142405s] [1.364142405s] END

	I1203 02:42:54.853636       1 trace.go:205] Trace[921726475]: "GuaranteedUpdate etcd3" type:*coordination.Lease (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[921726475]: ---"Transaction committed" 1583ms (02:42:54.853)

	Trace[921726475]: [1.584390803s] [1.584390803s] END

	I1203 02:42:54.853975       1 trace.go:205] Trace[719452703]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/pause-20211203024124-532170,user-agent:kubelet/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:2d516ca3-d159-452f-a840-f129cf10d146,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.269) (total time: 1584ms):

	Trace[719452703]: ---"Object stored in database" 1584ms (02:42:54.853)

	Trace[719452703]: [1.584903164s] [1.584903164s] END

	I1203 02:42:54.854055       1 trace.go:205] Trace[1850500647]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:4359df40-5daa-4a50-bd70-f48390ea66ec,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:53.663) (total time: 1190ms):

	Trace[1850500647]: ---"About to write a response" 1190ms (02:42:54.853)

	Trace[1850500647]: [1.190501383s] [1.190501383s] END

	I1203 02:42:54.857513       1 trace.go:205] Trace[746149164]: "List etcd3" key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: (03-Dec-2021 02:42:52.997) (total time: 1859ms):

	Trace[746149164]: [1.859677903s] [1.859677903s] END

	I1203 02:42:54.858039       1 trace.go:205] Trace[100308926]: "List" url:/api/v1/nodes,user-agent:kindnetd/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:9ee7eb23-38af-4c85-8170-deb854735830,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:52.997) (total time: 1860ms):

	Trace[100308926]: ---"Listing from storage done" 1859ms (02:42:54.857)

	Trace[100308926]: [1.860215353s] [1.860215353s] END

	* ==> kube-controller-manager [da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd] <==

	* I1203 02:42:19.598432       1 shared_informer.go:247] Caches are synced for resource quota

	I1203 02:42:19.598469       1 shared_informer.go:247] Caches are synced for PVC protection

	I1203 02:42:19.598487       1 shared_informer.go:247] Caches are synced for deployment

	I1203 02:42:19.598941       1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.605085       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.623094       1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:42:19.629084       1 shared_informer.go:247] Caches are synced for persistent volume

	I1203 02:42:19.638354       1 shared_informer.go:247] Caches are synced for namespace

	I1203 02:42:19.641965       1 shared_informer.go:247] Caches are synced for service account

	I1203 02:42:19.697287       1 shared_informer.go:247] Caches are synced for attach detach

	I1203 02:42:19.698168       1 shared_informer.go:247] Caches are synced for PV protection

	I1203 02:42:19.698204       1 shared_informer.go:247] Caches are synced for expand

	I1203 02:42:19.723295       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5xmj2"

	I1203 02:42:19.723336       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-n6hkm"

	I1203 02:42:19.723690       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1203 02:42:19.800345       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:19.829969       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-qwmpd"

	I1203 02:42:20.016290       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1203 02:42:20.026075       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:20.097398       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177064       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177104       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1203 02:42:34.546360       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	E1203 02:43:35.121711       1 resource_quota_controller.go:413] failed to discover resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	W1203 02:43:35.121726       1 garbagecollector.go:705] failed to discover preferred resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	* ==> kube-proxy [b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf] <==

	* I1203 02:42:20.634200       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1203 02:42:20.634302       1 server_others.go:140] Detected node IP 192.168.49.2

	W1203 02:42:20.634321       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1203 02:42:21.018258       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1203 02:42:21.018308       1 server_others.go:212] Using iptables Proxier.

	I1203 02:42:21.018322       1 server_others.go:219] creating dualStackProxier for iptables.

	W1203 02:42:21.018342       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1203 02:42:21.018662       1 server.go:649] Version: v1.22.4

	I1203 02:42:21.020100       1 config.go:224] Starting endpoint slice config controller

	I1203 02:42:21.020120       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1203 02:42:21.020193       1 config.go:315] Starting service config controller

	I1203 02:42:21.020198       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1203 02:42:21.121119       1 shared_informer.go:247] Caches are synced for service config

	I1203 02:42:21.121195       1 shared_informer.go:247] Caches are synced for endpoint slice config

	* ==> kube-scheduler [377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac] <==

	* W1203 02:42:03.294201       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1203 02:42:03.406171       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1203 02:42:03.406300       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1203 02:42:03.406324       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1203 02:42:03.406344       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1203 02:42:03.407679       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1203 02:42:03.415896       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1203 02:42:03.416427       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.418623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1203 02:42:03.421833       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1203 02:42:03.422567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1203 02:42:03.422726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.422862       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1203 02:42:03.423000       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:03.423347       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423470       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423544       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1203 02:42:03.423558       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:03.423644       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1203 02:42:03.424827       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1203 02:42:04.333813       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:04.364124       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:04.365071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:04.472526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I1203 02:42:04.906826       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:38 UTC. --

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.759016    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.769175    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862569    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-cni-cfg\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862653    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-lib-modules\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862702    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-xtables-lock\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862735    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/368971a0-2c0b-44f2-b66d-3257c9f080f4-lib-modules\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862769    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/9b4f2238-af1f-487f-80ff-a0a932437cee-xtables-lock\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862848    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-proxy\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862905    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fj6q\" (UniqueName: \"kubernetes.io/projected/368971a0-2c0b-44f2-b66d-3257c9f080f4-kube-api-access-6fj6q\") pod \"kindnet-n6hkm\" (UID: \"368971a0-2c0b-44f2-b66d-3257c9f080f4\") "

	Dec 03 02:42:19 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:19.862938    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt4z\" (UniqueName: \"kubernetes.io/projected/9b4f2238-af1f-487f-80ff-a0a932437cee-kube-api-access-cjt4z\") pod \"kube-proxy-5xmj2\" (UID: \"9b4f2238-af1f-487f-80ff-a0a932437cee\") "

	Dec 03 02:42:21 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:21.617953    1250 kubelet.go:2337] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.825477    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961188    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-config-volume\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:32 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:32.961235    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt727\" (UniqueName: \"kubernetes.io/projected/7f97c64e-1e68-4356-a1b5-f77f7cc81b24-kube-api-access-wt727\") pod \"coredns-78fcd69978-qwmpd\" (UID: \"7f97c64e-1e68-4356-a1b5-f77f7cc81b24\") "

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155456    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: W1203 02:42:38.155462    1250 clientconn.go:1326] [core] grpc: addrConn.createTransport failed to connect to {/run/containerd/containerd.sock /run/containerd/containerd.sock <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory". Reconnecting...

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.524995    1250 remote_runtime.go:207] "ListPodSandbox with filter from runtime service failed" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\"" filter="nil"

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525058    1250 kuberuntime_sandbox.go:281] "Failed to list pod sandboxes" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:38 pause-20211203024124-532170 kubelet[1250]: E1203 02:42:38.525083    1250 generic.go:205] "GenericPLEG: Unable to retrieve pods" err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /run/containerd/containerd.sock: connect: no such file or directory\""

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.840523    1250 topology_manager.go:200] "Topology Admit Handler"

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997439    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/9aa5302f-010c-4351-96c2-b2485180be47-tmp\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:50 pause-20211203024124-532170 kubelet[1250]: I1203 02:42:50.997691    1250 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfl2n\" (UniqueName: \"kubernetes.io/projected/9aa5302f-010c-4351-96c2-b2485180be47-kube-api-access-cfl2n\") pod \"storage-provisioner\" (UID: \"9aa5302f-010c-4351-96c2-b2485180be47\") "

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: kubelet.service: Succeeded.

	Dec 03 02:42:54 pause-20211203024124-532170 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8] <==

	* I1203 02:42:51.601493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1203 02:42:51.615295       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1203 02:42:51.615709       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1203 02:42:51.641608       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1203 02:42:51.641868       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

	I1203 02:42:51.643094       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbc908e7-bac3-41f4-ad8a-28a0acbab933", APIVersion:"v1", ResourceVersion:"527", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d became leader

	I1203 02:42:51.742125       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

-- /stdout --

** stderr **

	E1203 02:43:37.945265  674312 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

=== CONT  TestPause/serial/VerifyStatus

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (481.045721ms)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211203024124-532170" apiserver is not running, skipping kubectl commands (state="Paused")

--- FAIL: TestPause/serial/VerifyStatus (13.28s)

–

TestPause/serial/PauseAgain (34.67s)

=== RUN   TestPause/serial/PauseAgain

pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5

=== CONT  TestPause/serial/PauseAgain

pause_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5: exit status 80 (9.851356445s)

-- stdout --

	* Pausing node pause-20211203024124-532170 ...

-- /stdout --

** stderr **

	I1203 02:43:39.663380  676554 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:43:39.663480  676554 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:39.663485  676554 out.go:310] Setting ErrFile to fd 2...

	I1203 02:43:39.663489  676554 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:39.663601  676554 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:43:39.663813  676554 out.go:304] Setting JSON to false

	I1203 02:43:39.663851  676554 mustload.go:65] Loading cluster: pause-20211203024124-532170

	I1203 02:43:39.664219  676554 config.go:176] Loaded profile config "pause-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:43:39.664818  676554 cli_runner.go:115] Run: docker container inspect pause-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:39.710968  676554 host.go:66] Checking if "pause-20211203024124-532170" exists ...

	I1203 02:43:39.711304  676554 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:39.799672  676554 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:74 OomKillDisable:true NGoroutines:75 SystemTime:2021-12-03 02:43:39.750841742 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:43:39.800179  676554 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bo

ol=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/13059/minikube-v1.24.0-1638385553-13059.iso https://github.com/kubernetes/minikube/releases/download/v1.24.0-1638385553-13059/minikube-v1.24.0-1638385553-13059.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.24.0-1638385553-13059.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-

plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20211203024124-532170 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I1203 02:43:39.802737  676554 out.go:176] * Pausing node pause-20211203024124-532170 ...

	I1203 02:43:39.802762  676554 host.go:66] Checking if "pause-20211203024124-532170" exists ...

	I1203 02:43:39.803483  676554 ssh_runner.go:195] Run: systemctl --version

	I1203 02:43:39.803542  676554 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20211203024124-532170

	I1203 02:43:39.846288  676554 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33286 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/pause-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:39.925827  676554 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:43:39.996798  676554 pause.go:50] kubelet running: true

	I1203 02:43:39.996868  676554 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I1203 02:43:44.719940  676554 ssh_runner.go:235] Completed: sudo systemctl disable --now kubelet: (4.723046222s)

	I1203 02:43:46.518810  676554 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:running Name: Namespaces:[kube-system kubernetes-dashboard storage-gluster istio-operator]}

	I1203 02:43:46.519006  676554 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system; crictl ps -a --quiet --label io.kubernetes.pod.namespace=kubernetes-dashboard; crictl ps -a --quiet --label io.kubernetes.pod.namespace=storage-gluster; crictl ps -a --quiet --label io.kubernetes.pod.namespace=istio-operator"

	I1203 02:43:46.610163  676554 cri.go:76] found id: "44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8"

	I1203 02:43:46.610196  676554 cri.go:76] found id: "fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf"

	I1203 02:43:46.610205  676554 cri.go:76] found id: "9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a"

	I1203 02:43:46.610212  676554 cri.go:76] found id: "b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf"

	I1203 02:43:46.610219  676554 cri.go:76] found id: "da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd"

	I1203 02:43:46.610227  676554 cri.go:76] found id: "377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac"

	I1203 02:43:46.610233  676554 cri.go:76] found id: "c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83"

	I1203 02:43:46.610241  676554 cri.go:76] found id: "7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4"

	I1203 02:43:46.610248  676554 cri.go:76] found id: ""

	I1203 02:43:46.610297  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1203 02:43:46.653550  676554 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","pid":1680,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d/rootfs","created":"2021-12-03T02:42:20.264783354Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-5xmj2_9b4f2238-af1f-487f-80ff-a0a932437cee"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","pid":991,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d5

37309aa240f93ac2fdfa449c","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c/rootfs","created":"2021-12-03T02:41:59.468855551Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-pause-20211203024124-532170_d38c5cafc0eadb77f3c31b03ddf6e989"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","pid":1005,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62/rootfs","created":"2021-12-03T02:41:59.568722379Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","i

o.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-pause-20211203024124-532170_1d840b763857e30c34b6698e9fa7570f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","pid":1143,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac/rootfs","created":"2021-12-03T02:41:59.92570495Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","pid":2587,"s

tatus":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8/rootfs","created":"2021-12-03T02:42:51.560749945Z","annotations":{"io.kubernetes.cri.container-name":"storage-provisioner","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","pid":1014,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2/rootfs","created":"2021-12-03T02:41:59.568796096Z","annotations":{"io.kubernetes

.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-pause-20211203024124-532170_2b61b38a825a0505d16b2d6a2a9cedfb"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","pid":1687,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2/rootfs","created":"2021-12-03T02:42:20.596836103Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-n6hkm_368971a0-2c0b-44f2-b66d-3257c9f080f4"},"owner":"root"},

{"ociVersion":"1.0.2-dev","id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","pid":998,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195/rootfs","created":"2021-12-03T02:41:59.568737058Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-pause-20211203024124-532170_d9c5bb1dd4c0e3a00c6f04d2449fcce4"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","pid":1077,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4","r

ootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4/rootfs","created":"2021-12-03T02:41:59.766374576Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","pid":1987,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da/rootfs","created":"2021-12-03T02:42:33.364777884Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da","io.kubernetes.cri.sandb

ox-log-directory":"/var/log/pods/kube-system_coredns-78fcd69978-qwmpd_7f97c64e-1e68-4356-a1b5-f77f7cc81b24"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","pid":2556,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f/rootfs","created":"2021-12-03T02:42:51.32106819Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_storage-provisioner_9aa5302f-010c-4351-96c2-b2485180be47"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","pid":1867,"status":"running","bundle":"/run/containerd/io.conta

inerd.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a/rootfs","created":"2021-12-03T02:42:21.456633358Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","pid":1718,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf/rootfs","created":"2021-12-03T02:42:20.536651488Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.contai

ner-type":"container","io.kubernetes.cri.sandbox-id":"1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","pid":1136,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83/rootfs","created":"2021-12-03T02:41:59.868290191Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd","pid":1152,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8c

ef0af731ccbbe2fe9f197dd","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd/rootfs","created":"2021-12-03T02:41:59.928696433Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","pid":2019,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf/rootfs","created":"2021-12-03T02:42:33.648769478Z","annotations":{"io.kubernetes.cri.container-name":"coredns","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"989b0a2

0cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da"},"owner":"root"}]

	I1203 02:43:46.653776  676554 cri.go:113] list returned 16 containers

	I1203 02:43:46.653794  676554 cri.go:116] container: {ID:1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d Status:running}

	I1203 02:43:46.653809  676554 cri.go:118] skipping 1150dc7540b90bd2c4a50ddd37e291d8b5b53ebc8f30861bd69eabdb8cb5c03d - not in ps

	I1203 02:43:46.653815  676554 cri.go:116] container: {ID:1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c Status:running}

	I1203 02:43:46.653824  676554 cri.go:118] skipping 1a438759f3a6e291ca338642bc87e885a486d7d537309aa240f93ac2fdfa449c - not in ps

	I1203 02:43:46.653829  676554 cri.go:116] container: {ID:26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 Status:running}

	I1203 02:43:46.653838  676554 cri.go:118] skipping 26442a09720c68bb0cf3763c7b29d02acba5cb4a86bfdfd5837c291c62e15c62 - not in ps

	I1203 02:43:46.653846  676554 cri.go:116] container: {ID:377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac Status:running}

	I1203 02:43:46.653855  676554 cri.go:116] container: {ID:44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8 Status:running}

	I1203 02:43:46.653861  676554 cri.go:116] container: {ID:4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 Status:running}

	I1203 02:43:46.653871  676554 cri.go:118] skipping 4b59fc65934a4d1db5162370a8a418086d777ef9f626bdb0ec95e43f8caebae2 - not in ps

	I1203 02:43:46.653876  676554 cri.go:116] container: {ID:52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 Status:running}

	I1203 02:43:46.653886  676554 cri.go:118] skipping 52fd468fab925b0ce3f6717273564e197b13ac473a454f1a6b89ab38e9e832b2 - not in ps

	I1203 02:43:46.653892  676554 cri.go:116] container: {ID:75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 Status:running}

	I1203 02:43:46.653902  676554 cri.go:118] skipping 75715f0308eb13feb3e61ce039736ca12c9e5290f9133c2d31b2440b709e4195 - not in ps

	I1203 02:43:46.653907  676554 cri.go:116] container: {ID:7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4 Status:running}

	I1203 02:43:46.653913  676554 cri.go:116] container: {ID:989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da Status:running}

	I1203 02:43:46.653922  676554 cri.go:118] skipping 989b0a20cd6bf68f31e3f0e13ec1f38a08139a4143c3476766ea123fb4d7c6da - not in ps

	I1203 02:43:46.653927  676554 cri.go:116] container: {ID:9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f Status:running}

	I1203 02:43:46.653933  676554 cri.go:118] skipping 9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f - not in ps

	I1203 02:43:46.653938  676554 cri.go:116] container: {ID:9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a Status:running}

	I1203 02:43:46.653947  676554 cri.go:116] container: {ID:b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf Status:running}

	I1203 02:43:46.653953  676554 cri.go:116] container: {ID:c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83 Status:running}

	I1203 02:43:46.653963  676554 cri.go:116] container: {ID:da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd Status:running}

	I1203 02:43:46.653968  676554 cri.go:116] container: {ID:fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf Status:running}

	I1203 02:43:46.654020  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac

	I1203 02:43:46.671559  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8

	I1203 02:43:46.688338  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4

	I1203 02:43:46.707031  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause 9fe05a46928d77033acd027e53fc3377963639ad7b808f26355742d594065e8a

	I1203 02:43:46.723573  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf

	I1203 02:43:46.742208  676554 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83

	I1203 02:43:48.609168  676554 out.go:176]

	W1203 02:43:48.609389  676554 out.go:241] X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:46Z" level=error msg="unable to freeze"

	X Exiting due to GUEST_PAUSE: runc: sudo runc --root /run/containerd/runc/k8s.io pause c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:46Z" level=error msg="unable to freeze"

	W1203 02:43:48.609412  676554 out.go:241] *

	W1203 02:43:48.612883  676554 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1203 02:43:49.412549  676554 out.go:176]

** /stderr **

pause_test.go:110: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20211203024124-532170 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211203024124-532170

helpers_test.go:236: (dbg) docker inspect pause-20211203024124-532170:

-- stdout --

	        "Id": "2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc",

	        "Created": "2021-12-03T02:41:26.275196666Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 651787,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-03T02:41:27.094995507Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hostname",

	        "HostsPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hosts",

	        "LogPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc-json.log",

	        "Name": "/pause-20211203024124-532170",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211203024124-532170:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20211203024124-532170",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf-init/diff:/var/lib/docker/overlay2/6ac4080541cfeacde0b54b862ed3e8c1497bf3d3f22b73f3dd4ce1f668e19c72/diff:/var/lib/docker/overlay2/3e23ff251c4a4f7c2bc4e503098b4a2c6cc61a1d99b51a599fab585fe722bb1b/diff:/var/lib/docker/overlay2/cc6e93735a0ca1de72f287a78429adcbf52754f7b56e82fd10136b36df126cb7/diff:/var/lib/docker/overlay2/9b91525d2aa18b23a08318fd216cf0dd395530e8ee0971ef4ee837687f222c44/diff:/var/lib/docker/overlay2/afd7645dd1e3de615d5e6b8e38717640c35dd9d0dbad5d79e1e72c29f519e047/diff:/var/lib/docker/overlay2/e42185b4ffd5fd72d5dd3032240c65ebde359f8e05c73af3d0187f32c837a786/diff:/var/lib/docker/overlay2/fc00a8e7d591e187ad76a50b07d8c5a06e15c107d4f840ccea15b68e28da1980/diff:/var/lib/docker/overlay2/a29bf1481ece426838b6a498b3effdf9ff07fce93c547917247a80b257a1fe6a/diff:/var/lib/docker/overlay2/d08861a8de693171af3100608e63638de0eff4ee0ab9dad23a141b63c9fc78ba/diff:/var/lib/docker/overlay2/a810fd

33b8bdb6290817982a645db1f3f53d332f221af803394694d926de6ca1/diff:/var/lib/docker/overlay2/82d5a8bdd562d849d98ab607f16a3a733ccc7b8f078412597b1324d4fadd3be1/diff:/var/lib/docker/overlay2/1a93d862337e75ae7f4350d3b11066c9de4c24aceee76546de610057f617281d/diff:/var/lib/docker/overlay2/016cb2f9bec981cb59ea9c574c581bad8e88da405748168504b409ab365eb79b/diff:/var/lib/docker/overlay2/83e41d3d061b2ae009fb28d0223691d1ec84632e4b835f49eec164d4466dae2d/diff:/var/lib/docker/overlay2/0ce62a53786be1b733f4d9a3f0bb5d6eddb1df23134f5b87286ea0a0cf9fbbf0/diff:/var/lib/docker/overlay2/c13141fe83f4579fcc3d40c499982793faebda827f5ca6cc5534911b1ec393f6/diff:/var/lib/docker/overlay2/55fce7735b2305346d30a554960b07ae732bacdfbc399692dd2506c80daf9877/diff:/var/lib/docker/overlay2/252a160a3b32162d3ff13c40ccc33cabd273340235797ebee736493a1029eda7/diff:/var/lib/docker/overlay2/fce6704ef3f6cc37735e8972372e0f5e0bfbf4af83f5ff6fd027e174c59578e0/diff:/var/lib/docker/overlay2/88c75fcb26b5194e243c651225b00fb638c5ea62eb979d7df5b728df5ef5195a/diff:/var/lib/d

ocker/overlay2/0771e6e29be058dc4b8a5521020f5d66e3e4f0996747baea7cb18371e3545b6b/diff:/var/lib/docker/overlay2/9b15999e93e34bb79fccce68ef9de2dfe1780f1d4c0595f52d15981d7090babb/diff:/var/lib/docker/overlay2/8fd40ec7570ab0690e15c09834e3bc5284b3badf0f5b98cf234cc063d023fbce/diff:/var/lib/docker/overlay2/317d010d230847ac38e52570cb1bf66b55a735ba2fcd26045ca1d928fee269e9/diff:/var/lib/docker/overlay2/9e0744f6558a5e30811c7bc770686bb03018000ec5504f0a7342d648858c6520/diff:/var/lib/docker/overlay2/2b1e4978e05c0bbd41e0db471a4546b47e88d4d07bba062e641ee19252fbe324/diff:/var/lib/docker/overlay2/8a5ad66f897aa93b3a59cb81de4d6f3a4437cdf29b1daaac0470479e0627d353/diff:/var/lib/docker/overlay2/4c73a8fc02a1854c714f156081c2ed75e595e3dde9226820f21ff9353b52fbb7/diff:/var/lib/docker/overlay2/be02751327b17c0e71631c5e6cbea324ca807f35ff112d906955328aabd427d8/diff:/var/lib/docker/overlay2/500480e16cba6dcc737fbaabcd657d62a6d877b3505eec63f1de6e5e3c9dbb92/diff:/var/lib/docker/overlay2/2cd99ae5cfb49d19c25b95ac17d84a6889e691672d6d93a9f066ca8b7c4

5289f/diff:/var/lib/docker/overlay2/bc1787830a034113efe9235ddf0dc8652dfff6e7926a63d839120bbe9ebc0b99/diff:/var/lib/docker/overlay2/44149fe8e3297368fee684058e3d52cef2712454b3145aa883bcb63bbae8542f/diff:/var/lib/docker/overlay2/433b47ea5ada41625d6479daf7944dc706ab5abbcad92f65a32b40a754cbf645/diff:/var/lib/docker/overlay2/77082cd9d165ff33aaddc632231ac2ea8dc30f9073037fc9c3c97f50db12d5b2/diff:/var/lib/docker/overlay2/631d81e1d8b807f0a941170215bfd43566c2823909251d69246f84dc74dff425/diff:/var/lib/docker/overlay2/6eb234f85614a81f5323a7f51a68384027e94afd402c9851374d990371ebf594/diff:/var/lib/docker/overlay2/8c188ae964eaa37da1b63d82bc30f6d81e8a06ee2c1af3f12719f9cf443b6e09/diff:/var/lib/docker/overlay2/86d4eaadf1b0680172d06e3118a53a77440af3c8e5bde8c29bb97e7f94599244/diff:/var/lib/docker/overlay2/78fadeb69e3f7825d1bad64e2e686eff962fc4ed859de8fd0d2b2d30d56510a1/diff",

	                "MergedDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/merged",

	                "UpperDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/diff",

	                "WorkDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20211203024124-532170",

	                "Source": "/var/lib/docker/volumes/pause-20211203024124-532170/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20211203024124-532170",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "name.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c1242b1b033f16bedee595a0280553c95576e94729234572b5dbfcbd58cee8ec",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33286"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33285"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33282"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33284"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33283"

},

	            "SandboxKey": "/var/run/docker/netns/c1242b1b033f",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211203024124-532170": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "2fc356be3f9a"

],

	                    "NetworkID": "da1d0795a7d3bb5f007c696fba96d61b49ce95f6e99122ac37e1226dd45b8f38",

	                    "EndpointID": "59b7bb705dfc9e261679395a707aa0e1863d48a4a93f55f99fdcc3b7f3f19ed3",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (394.072803ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25: (11.776297391s)

helpers_test.go:253: TestPause/serial/PauseAgain logs:

-- stdout --

	* ==> Audit <==

	* |---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                    Args                    |                  Profile                   |  User   | Version |          Start Time           |           End Time            |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| start   | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:12 UTC | Fri, 03 Dec 2021 02:39:53 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --memory=2048 --driver=docker              |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:39:54 UTC | Fri, 03 Dec 2021 02:39:54 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --cancel-scheduled                         |                                            |         |         |                               |                               |

	| stop    | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:40:20 UTC | Fri, 03 Dec 2021 02:40:56 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	|         | --schedule 15s                             |                                            |         |         |                               |                               |

	| delete  | -p                                         | scheduled-stop-20211203023912-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:05 UTC | Fri, 03 Dec 2021 02:41:10 UTC |

	|         | scheduled-stop-20211203023912-532170       |                                            |         |         |                               |                               |

	| delete  | -p                                         | insufficient-storage-20211203024110-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:17 UTC | Fri, 03 Dec 2021 02:41:24 UTC |

	|         | insufficient-storage-20211203024110-532170 |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:41:32 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --no-kubernetes --driver=docker            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| profile | list                                       | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:33 UTC |

	| profile | list --output=json                         | minikube                                   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:34 UTC |

	| stop    | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:34 UTC | Fri, 03 Dec 2021 02:41:35 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| start   | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:35 UTC | Fri, 03 Dec 2021 02:41:53 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	|         | --driver=docker                            |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | NoKubernetes-20211203024124-532170         | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:53 UTC | Fri, 03 Dec 2021 02:41:59 UTC |

	|         | NoKubernetes-20211203024124-532170         |                                            |         |         |                               |                               |

	| delete  | -p                                         | kubenet-20211203024159-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:00 UTC | Fri, 03 Dec 2021 02:42:00 UTC |

	|         | kubenet-20211203024159-532170              |                                            |         |         |                               |                               |

	| delete  | -p                                         | flannel-20211203024200-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:01 UTC | Fri, 03 Dec 2021 02:42:01 UTC |

	|         | flannel-20211203024200-532170              |                                            |         |         |                               |                               |

	| delete  | -p false-20211203024201-532170             | false-20211203024201-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:02 UTC | Fri, 03 Dec 2021 02:42:02 UTC |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:36 UTC |

	|         | --memory=2048                              |                                            |         |         |                               |                               |

	|         | --install-addons=false                     |                                            |         |         |                               |                               |

	|         | --wait=all --driver=docker                 |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| start   | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:45 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048       |                                            |         |         |                               |                               |

	|         | --wait=true --driver=docker                |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| delete  | -p                                         | offline-containerd-20211203024124-532170   | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:45 UTC | Fri, 03 Dec 2021 02:42:49 UTC |

	|         | offline-containerd-20211203024124-532170   |                                            |         |         |                               |                               |

	| start   | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:36 UTC | Fri, 03 Dec 2021 02:42:52 UTC |

	|         | --alsologtostderr                          |                                            |         |         |                               |                               |

	|         | -v=1 --driver=docker                       |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:59 UTC | Fri, 03 Dec 2021 02:43:12 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:13 UTC | Fri, 03 Dec 2021 02:43:24 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	| -p      | pause-20211203024124-532170                | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:26 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | logs -n 25                                 |                                            |         |         |                               |                               |

	| start   | -p                                         | force-systemd-env-20211203024249-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:49 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | force-systemd-env-20211203024249-532170    |                                            |         |         |                               |                               |

	|         | --memory=2048 --alsologtostderr            |                                            |         |         |                               |                               |

	|         | -v=5 --driver=docker                       |                                            |         |         |                               |                               |

	|         | --container-runtime=containerd             |                                            |         |         |                               |                               |

	| -p      | force-systemd-env-20211203024249-532170    | force-systemd-env-20211203024249-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | ssh cat /etc/containerd/config.toml        |                                            |         |         |                               |                               |

	| unpause | -p pause-20211203024124-532170             | pause-20211203024124-532170                | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:39 UTC |

	|         | --alsologtostderr -v=5                     |                                            |         |         |                               |                               |

	| delete  | -p                                         | force-systemd-env-20211203024249-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:41 UTC |

	|         | force-systemd-env-20211203024249-532170    |                                            |         |         |                               |                               |

	|---------|--------------------------------------------|--------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:43:05

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:43:05.053241  670481 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:43:05.053349  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053360  670481 out.go:310] Setting ErrFile to fd 2...

	I1203 02:43:05.053366  670481 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:43:05.053498  670481 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:43:05.053757  670481 out.go:304] Setting JSON to false

	I1203 02:43:05.092504  670481 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":15946,"bootTime":1638483439,"procs":273,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:43:05.092647  670481 start.go:122] virtualization: kvm guest

	I1203 02:43:05.095532  670481 out.go:176] * [stopped-upgrade-20211203024124-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:43:05.097255  670481 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:05.095733  670481 notify.go:174] Checking for updates...

	I1203 02:43:05.098850  670481 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:43:05.100471  670481 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:43:05.101957  670481 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:43:05.102446  670481 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:43:05.105412  670481 out.go:176] * Kubernetes 1.22.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.4

	I1203 02:43:05.105461  670481 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:43:05.165355  670481 docker.go:132] docker version: linux-19.03.15

	I1203 02:43:05.165442  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.259347  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.203811101 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:43:05.259486  670481 docker.go:237] overlay module found

	I1203 02:43:05.261650  670481 out.go:176] * Using the docker driver based on existing profile

	I1203 02:43:05.261677  670481 start.go:280] selected driver: docker

	I1203 02:43:05.261683  670481 start.go:775] validating driver "docker" against &{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:m

inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.261780  670481 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:43:05.261826  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.261849  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.263387  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.264549  670481 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:43:05.366635  670481 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:48 OomKillDisable:true NGoroutines:50 SystemTime:2021-12-03 02:43:05.304972308 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W1203 02:43:05.366782  670481 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:43:05.366817  670481 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:43:05.368741  670481 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:43:05.368842  670481 cni.go:93] Creating CNI manager for ""

	I1203 02:43:05.368861  670481 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:05.368874  670481 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368883  670481 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:43:05.368895  670481 start_flags.go:282] config:

	{Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:05.370782  670481 out.go:176] * Starting control plane node stopped-upgrade-20211203024124-532170 in cluster stopped-upgrade-20211203024124-532170

	I1203 02:43:05.370819  670481 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:43:05.372360  670481 out.go:176] * Pulling base image ...

	I1203 02:43:05.372395  670481 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:05.372503  670481 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon

	W1203 02:43:05.483728  670481 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.20.0-containerd-overlay2-amd64.tar.lz4 status code: 404

	I1203 02:43:05.483888  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:05.483967  670481 cache.go:107] acquiring lock: {Name:mk58b755235faafd792a55ffc678df1b94a68bed Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484055  670481 cache.go:107] acquiring lock: {Name:mk52be53a20a12a6477d4b0e8db57a1c19c9d6b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484609  670481 cache.go:107] acquiring lock: {Name:mk7261047b045f5003b0a1499b53e56c4066fef9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484626  670481 cache.go:107] acquiring lock: {Name:mk3f28e99ceac9e8992f0b3b268ec7281c4e72db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484665  670481 cache.go:107] acquiring lock: {Name:mk15948f5fe3546c3f6679e86494b38857a18360 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.483973  670481 cache.go:107] acquiring lock: {Name:mkd85507bf8f9ec9c5c7efbe7e495c72c5a5c6cf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484643  670481 cache.go:107] acquiring lock: {Name:mke6a8256f44fd34328c51d78e752dc7a2edad5e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484757  670481 cache.go:107] acquiring lock: {Name:mke201119b191dfece838cdcc83d982d296b3f34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484901  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 exists

	I1203 02:43:05.484920  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists

	I1203 02:43:05.484932  670481 cache.go:107] acquiring lock: {Name:mk596458ff611e0392f6a3eaa557e2f3e7e8e7a2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.484952  670481 cache.go:96] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 902.757µs

	I1203 02:43:05.484975  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists

	I1203 02:43:05.484973  670481 cache.go:80] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded

	I1203 02:43:05.484933  670481 cache.go:96] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7" took 976.746µs

	I1203 02:43:05.484992  670481 cache.go:80] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 succeeded

	I1203 02:43:05.484991  670481 cache.go:96] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 942.364µs

	I1203 02:43:05.484947  670481 cache.go:107] acquiring lock: {Name:mk807a6c3536c72c72f3be8529e05e94b09807ad Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.485015  670481 cache.go:80] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded

	I1203 02:43:05.485038  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 exists

	I1203 02:43:05.485053  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I1203 02:43:05.485059  670481 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0" took 1.026757ms

	I1203 02:43:05.485076  670481 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 succeeded

	I1203 02:43:05.485074  670481 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.015687ms

	I1203 02:43:05.485091  670481 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I1203 02:43:05.485032  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 exists

	I1203 02:43:05.485106  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists

	I1203 02:43:05.485119  670481 cache.go:96] cache image "docker.io/kubernetesui/dashboard:v2.3.1" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1" took 191.686µs

	I1203 02:43:05.485134  670481 cache.go:80] save to tar file docker.io/kubernetesui/dashboard:v2.3.1 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 succeeded

	I1203 02:43:05.485056  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 exists

	I1203 02:43:05.485132  670481 cache.go:96] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 495.648µs

	I1203 02:43:05.485145  670481 cache.go:80] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded

	I1203 02:43:05.485160  670481 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0" took 541.414µs

	I1203 02:43:05.485181  670481 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 succeeded

	I1203 02:43:05.485238  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 exists

	I1203 02:43:05.485254  670481 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 exists

	I1203 02:43:05.485266  670481 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0" took 1.306673ms

	I1203 02:43:05.485270  670481 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.20.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0" took 531.113µs

	I1203 02:43:05.485285  670481 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 succeeded

	I1203 02:43:05.485297  670481 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.20.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 succeeded

	I1203 02:43:05.485305  670481 cache.go:87] Successfully saved all images to host disk.

	I1203 02:43:05.490644  670481 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 in local docker daemon, skipping pull

	I1203 02:43:05.490682  670481 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 exists in daemon, skipping load

	I1203 02:43:05.490695  670481 cache.go:206] Successfully downloaded all kic artifacts

	I1203 02:43:05.490725  670481 start.go:313] acquiring machines lock for stopped-upgrade-20211203024124-532170: {Name:mk214bf8f7074c905cdda6d55d9ae0d3cdd88bb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:43:05.490784  670481 start.go:317] acquired machines lock for "stopped-upgrade-20211203024124-532170" in 46.889µs

	I1203 02:43:05.490801  670481 start.go:93] Skipping create...Using existing machine configuration

	I1203 02:43:05.490809  670481 fix.go:55] fixHost starting:

	I1203 02:43:05.491017  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:05.543776  670481 fix.go:108] recreateIfNeeded on stopped-upgrade-20211203024124-532170: state=Stopped err=<nil>

	W1203 02:43:05.543831  670481 fix.go:134] unexpected machine state, will restart: <nil>

	I1203 02:43:01.948859  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "dmVyc2lvbiA9IDIKcm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQubW9uaXRvci52MS5jZ3JvdXBzIl0KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgI

CBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzYW5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My4yIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICBkaXNjYXJkX3VucGFja2VkX2xheWVycyA9IHRydWUKICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZ

XMucnVuY10KICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQubWsiCiAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5zZXJ2aWNlLnYxLmRpZmYtc2VydmljZSJdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5nYy52MS5zY2hlZHVsZXIiXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY

2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I1203 02:43:01.966266  668072 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1203 02:43:01.975871  668072 crio.go:138] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1203 02:43:01.975944  668072 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1203 02:43:01.987558  668072 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1203 02:43:01.994631  668072 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1203 02:43:02.088178  668072 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1203 02:43:02.199756  668072 start.go:403] Will wait 60s for socket path /run/containerd/containerd.sock

	I1203 02:43:02.199827  668072 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1203 02:43:02.209378  668072 start.go:424] Will wait 60s for crictl version

	I1203 02:43:02.209447  668072 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:02.242429  668072 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:02Z" level=fatal msg="getting the runtime version failed: rpc error: code = Unknown desc = server is not initialized yet"

	I1203 02:43:05.546133  670481 out.go:176] * Restarting existing docker container for "stopped-upgrade-20211203024124-532170" ...

	I1203 02:43:05.546230  670481 cli_runner.go:115] Run: docker start stopped-upgrade-20211203024124-532170

	I1203 02:43:06.204600  670481 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20211203024124-532170 --format={{.State.Status}}

	I1203 02:43:06.258790  670481 kic.go:420] container "stopped-upgrade-20211203024124-532170" state is running.

	I1203 02:43:06.259210  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.310989  670481 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/config.json ...

	I1203 02:43:06.311197  670481 machine.go:88] provisioning docker machine ...

	I1203 02:43:06.311219  670481 ubuntu.go:169] provisioning hostname "stopped-upgrade-20211203024124-532170"

	I1203 02:43:06.311260  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:06.364687  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:06.364915  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:06.364935  670481 main.go:130] libmachine: About to run SSH command:

	sudo hostname stopped-upgrade-20211203024124-532170 && echo "stopped-upgrade-20211203024124-532170" | sudo tee /etc/hostname

	I1203 02:43:06.365539  670481 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:53072->127.0.0.1:33318: read: connection reset by peer

	I1203 02:43:09.510602  670481 main.go:130] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-20211203024124-532170

	I1203 02:43:09.510704  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.563359  670481 main.go:130] libmachine: Using SSH client type: native

	I1203 02:43:09.563558  670481 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a0200] 0x7a32e0 <nil>  [] 0s} 127.0.0.1 33318 <nil> <nil>}

	I1203 02:43:09.563581  670481 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sstopped-upgrade-20211203024124-532170' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-20211203024124-532170/g' /etc/hosts;

				else

					echo '127.0.1.1 stopped-upgrade-20211203024124-532170' | sudo tee -a /etc/hosts;

fi

fi

	I1203 02:43:09.688295  670481 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I1203 02:43:09.688344  670481 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98

/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube}

	I1203 02:43:09.688368  670481 ubuntu.go:177] setting up certificates

	I1203 02:43:09.688379  670481 provision.go:83] configureAuth start

	I1203 02:43:09.688432  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:09.738851  670481 provision.go:138] copyHostCerts

	I1203 02:43:09.738917  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem, removing ...

	I1203 02:43:09.738931  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem

	I1203 02:43:09.738989  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.pem (1082 bytes)

	I1203 02:43:09.739126  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem, removing ...

	I1203 02:43:09.739145  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem

	I1203 02:43:09.739173  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cert.pem (1123 bytes)

	I1203 02:43:09.739266  670481 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem, removing ...

	I1203 02:43:09.739280  670481 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem

	I1203 02:43:09.739305  670481 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/key.pem (1675 bytes)

	I1203 02:43:09.739379  670481 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-20211203024124-532170 san=[192.168.59.203 127.0.0.1 localhost 127.0.0.1 minikube stopped-upgrade-20211203024124-532170]

	I1203 02:43:13.374906  666582 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:13.408492  666582 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.9

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:13.408566  666582 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.442414  666582 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.289658  668072 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:13.310235  668072 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.3

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:13.310308  668072 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.405019  668072 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:13.469787  666582 out.go:176] * Preparing Kubernetes v1.22.4 on containerd 1.4.9 ...

	I1203 02:43:13.469888  666582 cli_runner.go:115] Run: docker network inspect force-systemd-env-20211203024249-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:13.533845  666582 ssh_runner.go:195] Run: grep 192.168.58.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:13.537934  666582 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.58.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:13.550216  666582 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:43:13.550271  666582 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.575367  666582 containerd.go:635] all images are preloaded for containerd runtime.

	I1203 02:43:13.575390  666582 containerd.go:539] Images already preloaded, skipping extraction

	I1203 02:43:13.575437  666582 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.604322  666582 containerd.go:635] all images are preloaded for containerd runtime.

	I1203 02:43:13.604344  666582 cache_images.go:79] Images are preloaded, skipping loading

	I1203 02:43:13.604392  666582 ssh_runner.go:195] Run: sudo crictl info

	I1203 02:43:13.655453  666582 cni.go:93] Creating CNI manager for ""

	I1203 02:43:13.655480  666582 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:13.655495  666582 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1203 02:43:13.655517  666582 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.22.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:force-systemd-env-20211203024249-532170 NodeName:force-systemd-env-20211203024249-532170 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:

cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1203 02:43:13.655684  666582 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.58.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "force-systemd-env-20211203024249-532170"

	  kubeletExtraArgs:

	    node-ip: 192.168.58.2

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.4

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1203 02:43:13.655804  666582 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=force-systemd-env-20211203024249-532170 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.58.2 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.22.4 ClusterName:force-systemd-env-20211203024249-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1203 02:43:13.655876  666582 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.22.4

	I1203 02:43:13.665340  666582 binaries.go:44] Found k8s binaries, skipping transfer

	I1203 02:43:13.665395  666582 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1203 02:43:13.672776  666582 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (584 bytes)

	I1203 02:43:13.689078  666582 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1203 02:43:13.715673  666582 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2089 bytes)

	I1203 02:43:13.732847  666582 ssh_runner.go:195] Run: grep 192.168.58.2	control-plane.minikube.internal$ /etc/hosts

	I1203 02:43:13.738503  666582 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:13.757579  666582 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170 for IP: 192.168.58.2

	I1203 02:43:13.757691  666582 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key

	I1203 02:43:13.757737  666582 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key

	I1203 02:43:13.757790  666582 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key

	I1203 02:43:13.757806  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt with IP's: []

	I1203 02:43:14.006280  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt ...

	I1203 02:43:14.006314  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt: {Name:mk4d4683ea8e9216367aac396745b0fc9b1afedf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.006538  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key ...

	I1203 02:43:14.006581  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.key: {Name:mkcdaf5c481e4af436b24db927f1528e9f05c1e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.006736  666582 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041

	I1203 02:43:14.006777  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1203 02:43:10.207230  670481 provision.go:172] copyRemoteCerts

	I1203 02:43:11.691868  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1203 02:43:11.691914  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:11.740869  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:11.837960  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1203 02:43:11.859873  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1203 02:43:11.878401  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)

	I1203 02:43:11.896156  670481 provision.go:86] duration metric: configureAuth took 2.207759125s

	I1203 02:43:11.896187  670481 ubuntu.go:193] setting minikube options for container-runtime

	I1203 02:43:11.896407  670481 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:43:11.896425  670481 machine.go:91] provisioned docker machine in 5.585215428s

	I1203 02:43:11.896434  670481 start.go:267] post-start starting for "stopped-upgrade-20211203024124-532170" (driver="docker")

	I1203 02:43:11.896527  670481 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1203 02:43:11.896592  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1203 02:43:11.896638  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:11.948335  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.043755  670481 ssh_runner.go:195] Run: cat /etc/os-release

	I1203 02:43:12.046665  670481 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1203 02:43:12.046686  670481 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1203 02:43:12.046694  670481 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1203 02:43:12.046700  670481 info.go:137] Remote host: Ubuntu 20.04.1 LTS

	I1203 02:43:12.046708  670481 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/addons for local assets ...

	I1203 02:43:12.046749  670481 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files for local assets ...

	I1203 02:43:12.046833  670481 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem -> 5321702.pem in /etc/ssl/certs

	I1203 02:43:12.046922  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1203 02:43:12.053847  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:12.070286  670481 start.go:270] post-start completed in 173.83646ms

	I1203 02:43:12.070354  670481 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1203 02:43:12.070391  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.134886  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.230726  670481 fix.go:57] fixHost completed within 6.739910273s

	I1203 02:43:12.230752  670481 start.go:80] releasing machines lock for "stopped-upgrade-20211203024124-532170", held for 6.739957389s

	I1203 02:43:12.230833  670481 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.274590  670481 ssh_runner.go:195] Run: systemctl --version

	I1203 02:43:12.274645  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.274646  670481 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1203 02:43:12.274705  670481 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20211203024124-532170

	I1203 02:43:12.331772  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.355499  670481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33318 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/stopped-upgrade-20211203024124-532170/id_rsa Username:docker}

	I1203 02:43:12.421732  670481 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1203 02:43:12.456318  670481 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1203 02:43:12.469209  670481 docker.go:156] disabling docker service ...

	I1203 02:43:12.469256  670481 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1203 02:43:12.486072  670481 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1203 02:43:12.501409  670481 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1203 02:43:12.594277  670481 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1203 02:43:12.677996  670481 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1203 02:43:12.688263  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1203 02:43:12.704388  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc/containerd && printf %!s(MISSING) "dmVyc2lvbiA9IDIKcm9vdCA9ICIvdmFyL2xpYi9jb250YWluZXJkIgpzdGF0ZSA9ICIvcnVuL2NvbnRhaW5lcmQiCm9vbV9zY29yZSA9IDAKW2dycGNdCiAgYWRkcmVzcyA9ICIvcnVuL2NvbnRhaW5lcmQvY29udGFpbmVyZC5zb2NrIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbWF4X3JlY3ZfbWVzc2FnZV9zaXplID0gMTY3NzcyMTYKICBtYXhfc2VuZF9tZXNzYWdlX3NpemUgPSAxNjc3NzIxNgoKW2RlYnVnXQogIGFkZHJlc3MgPSAiIgogIHVpZCA9IDAKICBnaWQgPSAwCiAgbGV2ZWwgPSAiIgoKW21ldHJpY3NdCiAgYWRkcmVzcyA9ICIiCiAgZ3JwY19oaXN0b2dyYW0gPSBmYWxzZQoKW2Nncm91cF0KICBwYXRoID0gIiIKCltwcm94eV9wbHVnaW5zXQojIGZ1c2Utb3ZlcmxheWZzIGlzIHVzZWQgZm9yIHJvb3RsZXNzCltwcm94eV9wbHVnaW5zLiJmdXNlLW92ZXJsYXlmcyJdCiAgdHlwZSA9ICJzbmFwc2hvdCIKICBhZGRyZXNzID0gIi9ydW4vY29udGFpbmVyZC1mdXNlLW92ZXJsYXlmcy5zb2NrIgoKW3BsdWdpbnNdCiAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQubW9uaXRvci52MS5jZ3JvdXBzIl0KICAgIG5vX3Byb21ldGhldXMgPSBmYWxzZQogIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIl0KICAgIHN0cmVhbV9zZXJ2ZXJfYWRkcmVzcyA9ICIiCiAgI

CBzdHJlYW1fc2VydmVyX3BvcnQgPSAiMTAwMTAiCiAgICBlbmFibGVfc2VsaW51eCA9IGZhbHNlCiAgICBzYW5kYm94X2ltYWdlID0gIms4cy5nY3IuaW8vcGF1c2U6My4yIgogICAgc3RhdHNfY29sbGVjdF9wZXJpb2QgPSAxMAogICAgZW5hYmxlX3Rsc19zdHJlYW1pbmcgPSBmYWxzZQogICAgbWF4X2NvbnRhaW5lcl9sb2dfbGluZV9zaXplID0gMTYzODQKICAgIHJlc3RyaWN0X29vbV9zY29yZV9hZGogPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jb250YWluZXJkXQogICAgICBkaXNjYXJkX3VucGFja2VkX2xheWVycyA9IHRydWUKICAgICAgc25hcHNob3R0ZXIgPSAib3ZlcmxheWZzIgogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5kZWZhdWx0X3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gImlvLmNvbnRhaW5lcmQucnVuYy52MiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQudW50cnVzdGVkX3dvcmtsb2FkX3J1bnRpbWVdCiAgICAgICAgcnVudGltZV90eXBlID0gIiIKICAgICAgICBydW50aW1lX2VuZ2luZSA9ICIiCiAgICAgICAgcnVudGltZV9yb290ID0gIiIKICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZXNdCiAgICAgICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLmNvbnRhaW5lcmQucnVudGltZ

XMucnVuY10KICAgICAgICAgIHJ1bnRpbWVfdHlwZSA9ICJpby5jb250YWluZXJkLnJ1bmMudjIiCiAgICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIuY29udGFpbmVyZC5ydW50aW1lcy5ydW5jLm9wdGlvbnNdCiAgICAgICAgICAgIFN5c3RlbWRDZ3JvdXAgPSBmYWxzZQoKICAgIFtwbHVnaW5zLiJpby5jb250YWluZXJkLmdycGMudjEuY3JpIi5jbmldCiAgICAgIGJpbl9kaXIgPSAiL29wdC9jbmkvYmluIgogICAgICBjb25mX2RpciA9ICIvZXRjL2NuaS9uZXQubWsiCiAgICAgIGNvbmZfdGVtcGxhdGUgPSAiIgogICAgW3BsdWdpbnMuImlvLmNvbnRhaW5lcmQuZ3JwYy52MS5jcmkiLnJlZ2lzdHJ5XQogICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9yc10KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5ncnBjLnYxLmNyaSIucmVnaXN0cnkubWlycm9ycy4iZG9ja2VyLmlvIl0KICAgICAgICAgIGVuZHBvaW50ID0gWyJodHRwczovL3JlZ2lzdHJ5LTEuZG9ja2VyLmlvIl0KICAgICAgICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5zZXJ2aWNlLnYxLmRpZmYtc2VydmljZSJdCiAgICBkZWZhdWx0ID0gWyJ3YWxraW5nIl0KICBbcGx1Z2lucy4iaW8uY29udGFpbmVyZC5nYy52MS5zY2hlZHVsZXIiXQogICAgcGF1c2VfdGhyZXNob2xkID0gMC4wMgogICAgZGVsZXRpb25fdGhyZXNob2xkID0gMAogICAgbXV0YXRpb25fdGhyZXNob2xkID0gMTAwCiAgICBzY

2hlZHVsZV9kZWxheSA9ICIwcyIKICAgIHN0YXJ0dXBfZGVsYXkgPSAiMTAwbXMiCg==" | base64 -d | sudo tee /etc/containerd/config.toml"

	I1203 02:43:12.725626  670481 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1203 02:43:12.733897  670481 crio.go:138] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1203 02:43:12.733956  670481 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1203 02:43:12.742780  670481 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1203 02:43:12.750995  670481 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1203 02:43:12.820652  670481 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1203 02:43:12.909892  670481 start.go:403] Will wait 60s for socket path /run/containerd/containerd.sock

	I1203 02:43:12.909979  670481 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1203 02:43:12.915017  670481 start.go:424] Will wait 60s for crictl version

	I1203 02:43:12.915078  670481 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:12.933600  670481 retry.go:31] will retry after 11.04660288s: Temporary Error: sudo crictl version: Process exited with status 1

	stdout:

	stderr:

	time="2021-12-03T02:43:12Z" level=fatal msg="getting the runtime version failed: rpc error: code = Unknown desc = server is not initialized yet"

	I1203 02:43:13.507390  668072 out.go:176] * Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...

	I1203 02:43:13.507493  668072 cli_runner.go:115] Run: docker network inspect running-upgrade-20211203024210-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:13.561588  668072 ssh_runner.go:195] Run: grep 192.168.70.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:13.596504  668072 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:13.596566  668072 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:13.629395  668072 containerd.go:631] couldn't find preloaded image for "gcr.io/k8s-minikube/storage-provisioner:v5". assuming images are not preloaded.

	I1203 02:43:13.629422  668072 cache_images.go:83] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.20.0 k8s.gcr.io/kube-controller-manager:v1.20.0 k8s.gcr.io/kube-scheduler:v1.20.0 k8s.gcr.io/kube-proxy:v1.20.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1203 02:43:13.629489  668072 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:13.629708  668072 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:13.629821  668072 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:13.629922  668072 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:13.630044  668072 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:13.630147  668072 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1203 02:43:13.630256  668072 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:13.630356  668072 image.go:134] retrieving image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:13.630449  668072 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:13.630543  668072 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:13.631465  668072 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636690  668072 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636637  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.636645  668072 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:13.646552  668072 image.go:176] found k8s.gcr.io/pause:3.2 locally: &{UncompressedImageCore:0xc0005e03d0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:13.646605  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2"

	I1203 02:43:14.018537  668072 image.go:176] found gcr.io/k8s-minikube/storage-provisioner:v5 locally: &{UncompressedImageCore:0xc0005e02f0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:14.018603  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"

	I1203 02:43:14.053729  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0"

	I1203 02:43:14.127310  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0"

	I1203 02:43:14.133349  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0"

	I1203 02:43:14.133402  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0"

	I1203 02:43:14.199370  668072 image.go:176] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc0005e02b0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:14.199456  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0"

	I1203 02:43:14.295526  668072 cache_images.go:111] "k8s.gcr.io/pause:3.2" needs transfer: "k8s.gcr.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1203 02:43:14.295593  668072 cri.go:204] Removing image: k8s.gcr.io/pause:3.2

	I1203 02:43:14.295641  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:14.708121  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7"

	I1203 02:43:14.715519  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1"

	I1203 02:43:15.220915  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5": (1.202291307s)

	I1203 02:43:15.220971  668072 cache_images.go:111] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1203 02:43:15.221007  668072 cri.go:204] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:15.221050  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.437917  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0": (1.384141462s)

	I1203 02:43:15.437978  668072 cache_images.go:111] "k8s.gcr.io/kube-scheduler:v1.20.0" needs transfer: "k8s.gcr.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I1203 02:43:15.438017  668072 cri.go:204] Removing image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:15.438075  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.438205  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0": (1.310871764s)

	I1203 02:43:15.438232  668072 cache_images.go:111] "k8s.gcr.io/kube-apiserver:v1.20.0" needs transfer: "k8s.gcr.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I1203 02:43:15.438253  668072 cri.go:204] Removing image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:15.438296  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.512871  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0": (1.379433065s)

	I1203 02:43:15.512925  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0": (1.379532975s)

	I1203 02:43:15.512978  668072 cache_images.go:111] "k8s.gcr.io/kube-proxy:v1.20.0" needs transfer: "k8s.gcr.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I1203 02:43:15.513068  668072 cache_images.go:111] "k8s.gcr.io/kube-controller-manager:v1.20.0" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I1203 02:43:15.513101  668072 cri.go:204] Removing image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:15.513101  668072 cri.go:204] Removing image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:15.513148  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.513148  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.533241  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0": (1.333758933s)

	I1203 02:43:15.533285  668072 cache_images.go:111] "k8s.gcr.io/coredns:1.7.0" needs transfer: "k8s.gcr.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime

	I1203 02:43:15.533311  668072 cri.go:204] Removing image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:15.533362  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.533440  668072 ssh_runner.go:235] Completed: which crictl: (1.237786727s)

	I1203 02:43:15.533478  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.2

	I1203 02:43:15.738687  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7": (1.030489113s)

	I1203 02:43:15.738780  668072 cache_images.go:111] "docker.io/kubernetesui/metrics-scraper:v1.0.7" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.7" does not exist at hash "7801cfc6d5c072eb114355d369c830641064a246b5a774bcd668fac75ec728e9" in container runtime

	I1203 02:43:15.738833  668072 cri.go:204] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:15.738894  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.747701  668072 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1": (1.03213955s)

	I1203 02:43:15.747763  668072 cache_images.go:111] "docker.io/kubernetesui/dashboard:v2.3.1" needs transfer: "docker.io/kubernetesui/dashboard:v2.3.1" does not exist at hash "e1482a24335a6e76d438ae175f79409004588570d3e5dbb4c8140e025e848570" in container runtime

	I1203 02:43:15.747795  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:15.747800  668072 cri.go:204] Removing image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:15.747840  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:15.747924  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:15.747947  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:15.747948  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:15.748010  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:15.748088  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns:1.7.0

	I1203 02:43:15.748119  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I1203 02:43:15.748176  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2

	I1203 02:43:15.748182  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:15.912060  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7

	I1203 02:43:15.912163  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:15.994060  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.2: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/pause_3.2': No such file or directory

	I1203 02:43:15.994173  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 --> /var/lib/minikube/images/pause_3.2 (325632 bytes)

	I1203 02:43:15.994313  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0

	I1203 02:43:15.994418  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:15.994472  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0

	I1203 02:43:15.994536  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:15.994588  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0

	I1203 02:43:15.994646  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:15.994709  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0

	I1203 02:43:15.994763  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:15.994820  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0

	I1203 02:43:15.994872  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:15.994929  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:15.995075  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5

	I1203 02:43:15.995137  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:15.995217  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.7': No such file or directory

	I1203 02:43:15.995235  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 --> /var/lib/minikube/images/metrics-scraper_v1.0.7 (15031296 bytes)

	W1203 02:43:15.995725  668072 ssh_runner.go:129] session error, resetting client: ssh: rejected: connect failed (open failed)

	I1203 02:43:15.995765  668072 retry.go:31] will retry after 360.127272ms: ssh: rejected: connect failed (open failed)

	I1203 02:43:16.022326  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_1.7.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/coredns_1.7.0': No such file or directory

	I1203 02:43:16.022377  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 --> /var/lib/minikube/images/coredns_1.7.0 (16093184 bytes)

	I1203 02:43:16.022448  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.022807  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-scheduler_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-scheduler_v1.20.0': No such file or directory

	I1203 02:43:16.022837  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 --> /var/lib/minikube/images/kube-scheduler_v1.20.0 (14016512 bytes)

	I1203 02:43:16.022889  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.022934  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I1203 02:43:16.022968  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)

	I1203 02:43:16.023048  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023072  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-proxy_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-proxy_v1.20.0': No such file or directory

	I1203 02:43:16.023089  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 --> /var/lib/minikube/images/kube-proxy_v1.20.0 (49545216 bytes)

	I1203 02:43:16.023131  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023255  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-controller-manager_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-controller-manager_v1.20.0': No such file or directory

	I1203 02:43:16.023272  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 --> /var/lib/minikube/images/kube-controller-manager_v1.20.0 (29364736 bytes)

	I1203 02:43:16.023284  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/kube-apiserver_v1.20.0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/kube-apiserver_v1.20.0': No such file or directory

	I1203 02:43:16.023300  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 --> /var/lib/minikube/images/kube-apiserver_v1.20.0 (30411776 bytes)

	I1203 02:43:16.023321  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023340  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.023464  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1

	I1203 02:43:16.025608  668072 containerd.go:305] Loading image: /var/lib/minikube/images/pause_3.2

	I1203 02:43:16.025757  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2

	I1203 02:43:16.026007  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.056743  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:16.056855  668072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" running-upgrade-20211203024210-532170

	I1203 02:43:16.088921  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.146964  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.159619  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.184605  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.197368  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.202942  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.213310  668072 image.go:176] found k8s.gcr.io/etcd:3.4.13-0 locally: &{UncompressedImageCore:0xc0006301c8 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:16.213442  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.4.13-0"

	I1203 02:43:16.220811  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:16.224601  668072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33309 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/running-upgrade-20211203024210-532170/id_rsa Username:docker}

	I1203 02:43:14.127535  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 ...

	I1203 02:43:14.127592  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041: {Name:mk5f47ffc475df8c0a3bcf3c0c1a5cf5174d8b6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.127827  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041 ...

	I1203 02:43:14.127848  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041: {Name:mk8f4915f53e586d73e0361bd23da7153fa96e23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.128011  666582 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt.cee25041 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt

	I1203 02:43:14.128096  666582 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key.cee25041 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key

	I1203 02:43:14.128162  666582 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key

	I1203 02:43:14.128180  666582 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt with IP's: []

	I1203 02:43:14.391319  666582 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt ...

	I1203 02:43:14.391356  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt: {Name:mk87aaeb21870cb50c3d16b4298c870928863653 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.391572  666582 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key ...

	I1203 02:43:14.391591  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key: {Name:mkfe63eb61a3e464bc7c356ef4ff494653fc552d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:14.391709  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1203 02:43:14.391735  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1203 02:43:14.391751  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1203 02:43:14.391769  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1203 02:43:14.391785  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1203 02:43:14.391805  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1203 02:43:14.391820  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1203 02:43:14.391833  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1203 02:43:14.391895  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem (1338 bytes)

	W1203 02:43:14.391945  666582 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170_empty.pem, impossibly tiny 0 bytes

	I1203 02:43:14.391964  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem (1675 bytes)

	I1203 02:43:14.391997  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem (1082 bytes)

	I1203 02:43:14.392029  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem (1123 bytes)

	I1203 02:43:14.392068  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem (1675 bytes)

	I1203 02:43:14.392129  666582 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:14.392166  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.392182  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem -> /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.392198  666582 vm_assets.go:155] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem -> /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.393532  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1203 02:43:14.419883  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1203 02:43:14.442015  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1203 02:43:14.461307  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1203 02:43:14.479011  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1203 02:43:14.497470  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1203 02:43:14.522748  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1203 02:43:14.545105  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1203 02:43:14.563414  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1203 02:43:14.581826  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem --> /usr/share/ca-certificates/532170.pem (1338 bytes)

	I1203 02:43:14.601502  666582 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /usr/share/ca-certificates/5321702.pem (1708 bytes)

	I1203 02:43:14.626333  666582 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1203 02:43:14.641210  666582 ssh_runner.go:195] Run: openssl version

	I1203 02:43:14.646475  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5321702.pem && ln -fs /usr/share/ca-certificates/5321702.pem /etc/ssl/certs/5321702.pem"

	I1203 02:43:14.655094  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.658559  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec  3 02:15 /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.658610  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5321702.pem

	I1203 02:43:14.663759  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5321702.pem /etc/ssl/certs/3ec20f2e.0"

	I1203 02:43:14.672151  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1203 02:43:14.681066  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.684273  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec  3 02:10 /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.684320  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:14.689352  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1203 02:43:14.698464  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/532170.pem && ln -fs /usr/share/ca-certificates/532170.pem /etc/ssl/certs/532170.pem"

	I1203 02:43:14.708549  666582 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.716574  666582 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec  3 02:15 /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.716632  666582 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/532170.pem

	I1203 02:43:14.723822  666582 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/532170.pem /etc/ssl/certs/51391683.0"

	I1203 02:43:14.733783  666582 kubeadm.go:390] StartCluster: {Name:force-systemd-env-20211203024249-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:force-systemd-env-20211203024249-532170 Namespace:default APIServerName:minikubeCA APIServerNa

mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:43:14.733907  666582 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1203 02:43:14.733976  666582 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:14.760633  666582 cri.go:76] found id: ""

	I1203 02:43:14.760706  666582 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1203 02:43:14.768226  666582 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:14.775474  666582 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver

	I1203 02:43:14.775525  666582 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1203 02:43:14.782676  666582 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1203 02:43:14.782720  666582 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1203 02:43:17.013120  668072 cache_images.go:111] "k8s.gcr.io/etcd:3.4.13-0" needs transfer: "k8s.gcr.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime

	I1203 02:43:17.013177  668072 cri.go:204] Removing image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:17.013232  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:17.305829  668072 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: (1.249046831s)

	I1203 02:43:17.305882  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/dashboard_v2.3.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.3.1': No such file or directory

	I1203 02:43:17.305914  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 --> /var/lib/minikube/images/dashboard_v2.3.1 (66936320 bytes)

	I1203 02:43:17.306031  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2: (1.28015886s)

	I1203 02:43:17.306057  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 from cache

	I1203 02:43:17.306087  668072 containerd.go:305] Loading image: /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:17.306143  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:17.306263  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:19.131829  668072 ssh_runner.go:235] Completed: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0: (1.825528631s)

	I1203 02:43:19.131859  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0: (1.825687546s)

	I1203 02:43:19.131869  668072 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0

	I1203 02:43:19.131884  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 from cache

	I1203 02:43:19.131908  668072 containerd.go:305] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:19.131954  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:19.131964  668072 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:20.036231  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache

	I1203 02:43:20.036236  668072 ssh_runner.go:352] existence check for /var/lib/minikube/images/etcd_3.4.13-0: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/etcd_3.4.13-0': No such file or directory

	I1203 02:43:20.036272  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:20.036286  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 --> /var/lib/minikube/images/etcd_3.4.13-0 (98416128 bytes)

	I1203 02:43:20.036325  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:20.803180  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 from cache

	I1203 02:43:20.803218  668072 containerd.go:305] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:20.803257  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:23.980570  670481 ssh_runner.go:195] Run: sudo crictl version

	I1203 02:43:23.994908  670481 start.go:433] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.4.3

	RuntimeApiVersion:  v1alpha2

	I1203 02:43:23.994974  670481 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:24.025450  670481 ssh_runner.go:195] Run: containerd --version

	I1203 02:43:24.056378  670481 out.go:176] * Preparing Kubernetes v1.20.0 on containerd 1.4.3 ...

	I1203 02:43:24.056512  670481 cli_runner.go:115] Run: docker network inspect stopped-upgrade-20211203024124-532170 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1203 02:43:24.096031  670481 ssh_runner.go:195] Run: grep 192.168.59.1	host.minikube.internal$ /etc/hosts

	I1203 02:43:24.100345  670481 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.59.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:24.111886  670481 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1203 02:43:24.111937  670481 ssh_runner.go:195] Run: sudo crictl images --output json

	I1203 02:43:24.128575  670481 containerd.go:631] couldn't find preloaded image for "gcr.io/k8s-minikube/storage-provisioner:v5". assuming images are not preloaded.

	I1203 02:43:24.128608  670481 cache_images.go:83] LoadImages start: [k8s.gcr.io/kube-apiserver:v1.20.0 k8s.gcr.io/kube-controller-manager:v1.20.0 k8s.gcr.io/kube-scheduler:v1.20.0 k8s.gcr.io/kube-proxy:v1.20.0 k8s.gcr.io/pause:3.2 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5 docker.io/kubernetesui/dashboard:v2.3.1 docker.io/kubernetesui/metrics-scraper:v1.0.7]

	I1203 02:43:24.128684  670481 image.go:134] retrieving image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:24.128897  670481 image.go:134] retrieving image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:24.128920  670481 image.go:134] retrieving image: k8s.gcr.io/pause:3.2

	I1203 02:43:24.128996  670481 image.go:134] retrieving image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:24.129092  670481 image.go:134] retrieving image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:24.129116  670481 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:24.129183  670481 image.go:134] retrieving image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:24.129241  670481 image.go:134] retrieving image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:24.129283  670481 image.go:134] retrieving image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:24.129373  670481 image.go:134] retrieving image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:24.132942  670481 image.go:180] daemon lookup for docker.io/kubernetesui/metrics-scraper:v1.0.7: Error response from daemon: reference does not exist

	I1203 02:43:24.136775  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-apiserver:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141359  670481 image.go:180] daemon lookup for docker.io/kubernetesui/dashboard:v2.3.1: Error response from daemon: reference does not exist

	I1203 02:43:24.141562  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-proxy:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141745  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.141897  670481 image.go:180] daemon lookup for k8s.gcr.io/kube-scheduler:v1.20.0: Error response from daemon: reference does not exist

	I1203 02:43:24.146071  670481 image.go:176] found k8s.gcr.io/pause:3.2 locally: &{UncompressedImageCore:0xc000652438 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.146128  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/pause:3.2"

	I1203 02:43:24.315253  670481 cache_images.go:111] "k8s.gcr.io/pause:3.2" needs transfer: "k8s.gcr.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1203 02:43:24.315304  670481 cri.go:204] Removing image: k8s.gcr.io/pause:3.2

	I1203 02:43:24.315348  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.319331  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/pause:3.2

	I1203 02:43:24.358255  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I1203 02:43:24.358356  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.362335  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/pause_3.2 (exists)

	I1203 02:43:24.362360  670481 containerd.go:305] Loading image: /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.362401  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/pause_3.2

	I1203 02:43:24.548439  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-proxy:v1.20.0"

	I1203 02:43:24.549018  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-controller-manager:v1.20.0"

	I1203 02:43:24.554962  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-apiserver:v1.20.0"

	I1203 02:43:24.575504  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/pause_3.2 from cache

	I1203 02:43:24.591874  670481 image.go:176] found gcr.io/k8s-minikube/storage-provisioner:v5 locally: &{UncompressedImageCore:0xc00064a108 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.592002  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"

	I1203 02:43:24.659133  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/kube-scheduler:v1.20.0"

	I1203 02:43:24.758904  670481 image.go:176] found k8s.gcr.io/coredns:1.7.0 locally: &{UncompressedImageCore:0xc000010038 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:24.758973  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/coredns:1.7.0"

	I1203 02:43:24.823666  670481 cache_images.go:111] "k8s.gcr.io/kube-proxy:v1.20.0" needs transfer: "k8s.gcr.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I1203 02:43:24.823718  670481 cri.go:204] Removing image: k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:24.823767  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.838637  670481 cache_images.go:111] "k8s.gcr.io/kube-controller-manager:v1.20.0" needs transfer: "k8s.gcr.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I1203 02:43:24.838683  670481 cri.go:204] Removing image: k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:24.838742  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.895572  670481 cache_images.go:111] "k8s.gcr.io/kube-apiserver:v1.20.0" needs transfer: "k8s.gcr.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I1203 02:43:24.895642  670481 cri.go:204] Removing image: k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:24.895686  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.928776  670481 cache_images.go:111] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562" in container runtime

	I1203 02:43:24.928824  670481 cri.go:204] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:24.928878  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.960976  670481 cache_images.go:111] "k8s.gcr.io/kube-scheduler:v1.20.0" needs transfer: "k8s.gcr.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I1203 02:43:24.961032  670481 cri.go:204] Removing image: k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:24.961071  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:21.916298  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.7: (1.113009595s)

	I1203 02:43:21.916331  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 from cache

	I1203 02:43:21.916376  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:21.916454  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:22.740030  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 from cache

	I1203 02:43:22.740076  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:22.740130  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:23.546417  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 from cache

	I1203 02:43:23.546461  668072 containerd.go:305] Loading image: /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:23.546510  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:24.996385  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0: (1.449847057s)

	I1203 02:43:24.996413  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 from cache

	I1203 02:43:24.996434  668072 containerd.go:305] Loading image: /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:24.996532  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:24.996774  670481 cache_images.go:111] "k8s.gcr.io/coredns:1.7.0" needs transfer: "k8s.gcr.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime

	I1203 02:43:24.996817  670481 cri.go:204] Removing image: k8s.gcr.io/coredns:1.7.0

	I1203 02:43:24.996861  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:24.996957  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-proxy:v1.20.0

	I1203 02:43:24.997032  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-controller-manager:v1.20.0

	I1203 02:43:24.997099  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-apiserver:v1.20.0

	I1203 02:43:24.997160  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:24.997222  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/kube-scheduler:v1.20.0

	I1203 02:43:25.148808  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/coredns:1.7.0

	I1203 02:43:25.148888  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0

	I1203 02:43:25.148959  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:25.149030  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0

	I1203 02:43:25.149091  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:25.149133  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0

	I1203 02:43:25.149182  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:25.149238  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0

	I1203 02:43:25.149294  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:25.149386  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5

	I1203 02:43:25.149443  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:25.186476  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-proxy_v1.20.0 (exists)

	I1203 02:43:25.186498  670481 containerd.go:305] Loading image: /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:25.186537  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0

	I1203 02:43:25.186541  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-scheduler_v1.20.0 (exists)

	I1203 02:43:25.186493  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0

	I1203 02:43:25.186601  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-apiserver_v1.20.0 (exists)

	I1203 02:43:25.186624  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/kube-controller-manager_v1.20.0 (exists)

	I1203 02:43:25.186643  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:25.186665  670481 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory

	I1203 02:43:25.186684  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (9060352 bytes)

	I1203 02:43:25.210893  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7"

	I1203 02:43:25.213106  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1"

	I1203 02:43:27.263055  670481 image.go:176] found k8s.gcr.io/etcd:3.4.13-0 locally: &{UncompressedImageCore:0xc00064a1a0 lock:{state:0 sema:0} manifest:<nil>}

	I1203 02:43:27.263138  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep k8s.gcr.io/etcd:3.4.13-0"

	I1203 02:43:28.063560  670481 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-proxy_v1.20.0: (2.87699711s)

	I1203 02:43:28.063592  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.0 from cache

	I1203 02:43:28.063634  670481 containerd.go:305] Loading image: /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:28.063686  670481 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/metrics-scraper:v1.0.7": (2.852759023s)

	I1203 02:43:28.063705  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-scheduler_v1.20.0

	I1203 02:43:28.063711  670481 ssh_runner.go:235] Completed: /bin/bash -c "sudo ctr -n=k8s.io images check | grep docker.io/kubernetesui/dashboard:v2.3.1": (2.850537754s)

	I1203 02:43:28.063727  670481 cache_images.go:111] "docker.io/kubernetesui/metrics-scraper:v1.0.7" needs transfer: "docker.io/kubernetesui/metrics-scraper:v1.0.7" does not exist at hash "7801cfc6d5c072eb114355d369c830641064a246b5a774bcd668fac75ec728e9" in container runtime

	I1203 02:43:28.063754  670481 cri.go:204] Removing image: docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:28.063636  670481 ssh_runner.go:235] Completed: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/coredns_1.7.0: (2.876974351s)

	I1203 02:43:28.063752  670481 cache_images.go:111] "docker.io/kubernetesui/dashboard:v2.3.1" needs transfer: "docker.io/kubernetesui/dashboard:v2.3.1" does not exist at hash "e1482a24335a6e76d438ae175f79409004588570d3e5dbb4c8140e025e848570" in container runtime

	I1203 02:43:28.063783  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/coredns_1.7.0 (exists)

	I1203 02:43:28.063797  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:28.063808  670481 cache_images.go:111] "k8s.gcr.io/etcd:3.4.13-0" needs transfer: "k8s.gcr.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime

	I1203 02:43:28.063823  670481 cri.go:204] Removing image: docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:28.063832  670481 cri.go:204] Removing image: k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:28.063870  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:28.063880  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:28.067824  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/metrics-scraper:v1.0.7

	I1203 02:43:28.067874  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi docker.io/kubernetesui/dashboard:v2.3.1

	I1203 02:43:28.367037  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi k8s.gcr.io/etcd:3.4.13-0

	I1203 02:43:28.367071  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.0 from cache

	I1203 02:43:28.367110  670481 containerd.go:305] Loading image: /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:28.367159  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7

	I1203 02:43:28.367208  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-apiserver_v1.20.0

	I1203 02:43:28.367221  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1

	I1203 02:43:28.367238  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:28.367301  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:28.404769  670481 cache_images.go:281] Loading image from: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0

	I1203 02:43:28.404898  670481 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:28.871131  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.0 from cache

	I1203 02:43:28.871186  670481 containerd.go:305] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:28.871200  670481 ssh_runner.go:352] existence check for /var/lib/minikube/images/metrics-scraper_v1.0.7: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/metrics-scraper_v1.0.7: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/metrics-scraper_v1.0.7': No such file or directory

	I1203 02:43:28.871229  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 --> /var/lib/minikube/images/metrics-scraper_v1.0.7 (15031296 bytes)

	I1203 02:43:28.871231  670481 ssh_runner.go:352] existence check for /var/lib/minikube/images/dashboard_v2.3.1: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/images/dashboard_v2.3.1: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/lib/minikube/images/dashboard_v2.3.1': No such file or directory

	I1203 02:43:28.871274  670481 ssh_runner.go:356] copy: skipping /var/lib/minikube/images/etcd_3.4.13-0 (exists)

	I1203 02:43:28.871286  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 --> /var/lib/minikube/images/dashboard_v2.3.1 (66936320 bytes)

	I1203 02:43:28.871245  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/kube-controller-manager_v1.20.0

	I1203 02:43:29.450042  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.0 from cache

	I1203 02:43:29.450088  670481 containerd.go:305] Loading image: /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:29.450134  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/storage-provisioner_v5

	I1203 02:43:29.897280  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache

	I1203 02:43:29.897334  670481 containerd.go:305] Loading image: /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:29.897386  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/coredns_1.7.0

	I1203 02:43:31.116510  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.3.1: (6.119950815s)

	I1203 02:43:31.116547  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 from cache

	I1203 02:43:31.116575  668072 containerd.go:305] Loading image: /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:31.116635  668072 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:32.364356  666582 out.go:203]   - Generating certificates and keys ...

	I1203 02:43:32.368297  666582 out.go:203]   - Booting up control plane ...

	I1203 02:43:32.370873  666582 out.go:203]   - Configuring RBAC rules ...

	I1203 02:43:32.373410  666582 cni.go:93] Creating CNI manager for ""

	I1203 02:43:32.373430  666582 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:32.375036  666582 out.go:176] * Configuring CNI (Container Networking Interface) ...

	I1203 02:43:32.375103  666582 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1203 02:43:32.380197  666582 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.22.4/kubectl ...

	I1203 02:43:32.380217  666582 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2429 bytes)

	I1203 02:43:32.395632  666582 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.22.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1203 02:43:33.576372  666582 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.22.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (1.180697932s)

	I1203 02:43:33.576426  666582 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1203 02:43:33.576567  666582 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.22.4/kubectl label nodes minikube.k8s.io/version=v1.24.0 minikube.k8s.io/commit=d2fd4eeaa53afc96e8420b11a1a9d4ddad2647db minikube.k8s.io/name=force-systemd-env-20211203024249-532170 minikube.k8s.io/updated_at=2021_12_03T02_43_33_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1203 02:43:33.576568  666582 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.22.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1203 02:43:33.594905  666582 ops.go:34] apiserver oom_adj: -16

	I1203 02:43:33.699904  666582 kubeadm.go:985] duration metric: took 123.459321ms to wait for elevateKubeSystemPrivileges.

	I1203 02:43:33.699937  666582 kubeadm.go:392] StartCluster complete in 18.966167877s

	I1203 02:43:33.699959  666582 settings.go:142] acquiring lock: {Name:mk42d2b6396720ed474fae56d643c4cd4288bb42 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:33.700066  666582 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:33.701847  666582 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig: {Name:mk08ee95b56499d1d159086ebdcfd257d76fd2de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:33.702880  666582 kapi.go:59] client config for force-systemd-env-20211203024249-532170: &rest.Config{Host:"https://192.168.58.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/pr

ofiles/force-systemd-env-20211203024249-532170/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15d5d20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1203 02:43:33.704591  666582 cert_rotation.go:137] Starting client certificate rotation controller

	I1203 02:43:34.230140  666582 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "force-systemd-env-20211203024249-532170" rescaled to 1

	I1203 02:43:34.230201  666582 start.go:229] Will wait 6m0s for node &{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}

	I1203 02:43:34.230276  666582 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1203 02:43:34.232330  666582 out.go:176] * Verifying Kubernetes components...

	I1203 02:43:34.230375  666582 addons.go:415] enableAddons start: toEnable=map[], additional=[]

	I1203 02:43:34.232410  666582 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:43:34.232440  666582 addons.go:65] Setting storage-provisioner=true in profile "force-systemd-env-20211203024249-532170"

	I1203 02:43:34.230473  666582 config.go:176] Loaded profile config "force-systemd-env-20211203024249-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:43:34.232533  666582 addons.go:153] Setting addon storage-provisioner=true in "force-systemd-env-20211203024249-532170"

	W1203 02:43:34.232542  666582 addons.go:165] addon storage-provisioner should already be in state true

	I1203 02:43:34.232576  666582 host.go:66] Checking if "force-systemd-env-20211203024249-532170" exists ...

	I1203 02:43:34.232588  666582 addons.go:65] Setting default-storageclass=true in profile "force-systemd-env-20211203024249-532170"

	I1203 02:43:34.232605  666582 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "force-systemd-env-20211203024249-532170"

	I1203 02:43:34.232973  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Status}}

	I1203 02:43:34.233154  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Status}}

	I1203 02:43:34.299653  666582 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1203 02:43:34.299790  666582 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1203 02:43:34.299806  666582 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1203 02:43:34.299864  666582 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20211203024249-532170

	I1203 02:43:34.297562  666582 kapi.go:59] client config for force-systemd-env-20211203024249-532170: &rest.Config{Host:"https://192.168.58.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/pr

ofiles/force-systemd-env-20211203024249-532170/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15d5d20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1203 02:43:34.305100  666582 addons.go:153] Setting addon default-storageclass=true in "force-systemd-env-20211203024249-532170"

	W1203 02:43:34.305126  666582 addons.go:165] addon default-storageclass should already be in state true

	I1203 02:43:34.305157  666582 host.go:66] Checking if "force-systemd-env-20211203024249-532170" exists ...

	I1203 02:43:34.305671  666582 cli_runner.go:115] Run: docker container inspect force-systemd-env-20211203024249-532170 --format={{.State.Status}}

	I1203 02:43:34.312742  666582 kapi.go:59] client config for force-systemd-env-20211203024249-532170: &rest.Config{Host:"https://192.168.58.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-env-20211203024249-532170/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/pr

ofiles/force-systemd-env-20211203024249-532170/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15d5d20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1203 02:43:34.314300  666582 api_server.go:51] waiting for apiserver process to appear ...

	I1203 02:43:34.314344  666582 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:34.314562  666582 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.58.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.22.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1203 02:43:34.374704  666582 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33314 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/force-systemd-env-20211203024249-532170/id_rsa Username:docker}

	I1203 02:43:34.374730  666582 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1203 02:43:34.374833  666582 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1203 02:43:34.374896  666582 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20211203024249-532170

	I1203 02:43:34.438890  666582 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33314 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/force-systemd-env-20211203024249-532170/id_rsa Username:docker}

	I1203 02:43:34.510906  666582 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1203 02:43:34.561092  666582 api_server.go:71] duration metric: took 330.817726ms to wait for apiserver process to appear ...

	I1203 02:43:34.561130  666582 api_server.go:87] waiting for apiserver healthz status ...

	I1203 02:43:34.561144  666582 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...

	I1203 02:43:34.561496  666582 start.go:739] {"host.minikube.internal": 192.168.58.1} host record injected into CoreDNS

	I1203 02:43:34.563502  666582 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1203 02:43:34.593874  666582 api_server.go:266] https://192.168.58.2:8443/healthz returned 200:

ok

	I1203 02:43:34.595717  666582 api_server.go:140] control plane version: v1.22.4

	I1203 02:43:34.595742  666582 api_server.go:130] duration metric: took 34.604959ms to wait for apiserver health ...

	I1203 02:43:34.595753  666582 system_pods.go:43] waiting for kube-system pods to appear ...

	I1203 02:43:34.605363  666582 system_pods.go:59] 0 kube-system pods found

	I1203 02:43:34.605435  666582 retry.go:31] will retry after 305.063636ms: only 0 pod(s) have shown up

	I1203 02:43:30.631794  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 from cache

	I1203 02:43:30.631843  670481 containerd.go:305] Loading image: /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:30.631895  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0

	I1203 02:43:32.177503  670481 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0: (1.545580544s)

	I1203 02:43:32.177535  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 from cache

	I1203 02:43:32.177555  670481 containerd.go:305] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:32.177603  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/metrics-scraper_v1.0.7

	I1203 02:43:32.796602  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.7 from cache

	I1203 02:43:32.796639  670481 containerd.go:305] Loading image: /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:32.796689  670481 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.3.1

	I1203 02:43:33.748567  668072 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/etcd_3.4.13-0: (2.631903038s)

	I1203 02:43:33.748599  668072 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 from cache

	I1203 02:43:33.748620  668072 cache_images.go:118] Successfully loaded all cached images

	I1203 02:43:33.748626  668072 cache_images.go:87] LoadImages completed in 20.119188922s

	I1203 02:43:33.748684  668072 ssh_runner.go:195] Run: sudo crictl info

	I1203 02:43:33.795523  668072 cni.go:93] Creating CNI manager for ""

	I1203 02:43:33.795556  668072 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:33.795571  668072 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1203 02:43:33.795587  668072 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.70.203 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:running-upgrade-20211203024210-532170 NodeName:running-upgrade-20211203024210-532170 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.70.203"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.70.203 CgroupDrive

r:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1203 02:43:33.795787  668072 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.70.203

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "running-upgrade-20211203024210-532170"

	  kubeletExtraArgs:

	    node-ip: 192.168.70.203

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.70.203"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1203 02:43:33.795927  668072 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=running-upgrade-20211203024210-532170 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.70.203 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20211203024210-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1203 02:43:33.795993  668072 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I1203 02:43:33.804978  668072 binaries.go:44] Found k8s binaries, skipping transfer

	I1203 02:43:33.805072  668072 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1203 02:43:33.814043  668072 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (584 bytes)

	I1203 02:43:33.830649  668072 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1203 02:43:34.013295  668072 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2093 bytes)

	I1203 02:43:34.031723  668072 ssh_runner.go:195] Run: grep 192.168.70.203	control-plane.minikube.internal$ /etc/hosts

	I1203 02:43:34.035706  668072 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170 for IP: 192.168.70.203

	I1203 02:43:34.035856  668072 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key

	I1203 02:43:34.035913  668072 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key

	I1203 02:43:34.036029  668072 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/client.key

	I1203 02:43:34.036107  668072 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/apiserver.key.b3791c29

	I1203 02:43:34.036159  668072 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/proxy-client.key

	I1203 02:43:34.036304  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem (1338 bytes)

	W1203 02:43:34.036370  668072 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170_empty.pem, impossibly tiny 0 bytes

	I1203 02:43:34.036388  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem (1675 bytes)

	I1203 02:43:34.036424  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem (1082 bytes)

	I1203 02:43:34.036512  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem (1123 bytes)

	I1203 02:43:34.036551  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem (1675 bytes)

	I1203 02:43:34.036611  668072 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:34.037885  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1203 02:43:34.059723  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1203 02:43:34.106141  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1203 02:43:34.130227  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1203 02:43:34.150852  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1203 02:43:34.209236  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1203 02:43:34.231495  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1203 02:43:34.258369  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1203 02:43:34.317072  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /usr/share/ca-certificates/5321702.pem (1708 bytes)

	I1203 02:43:34.356300  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1203 02:43:34.418707  668072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem --> /usr/share/ca-certificates/532170.pem (1338 bytes)

	I1203 02:43:34.452781  668072 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1203 02:43:34.470929  668072 ssh_runner.go:195] Run: openssl version

	I1203 02:43:34.477498  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5321702.pem && ln -fs /usr/share/ca-certificates/5321702.pem /etc/ssl/certs/5321702.pem"

	I1203 02:43:34.500108  668072 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5321702.pem

	I1203 02:43:34.504566  668072 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec  3 02:15 /usr/share/ca-certificates/5321702.pem

	I1203 02:43:34.504640  668072 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5321702.pem

	I1203 02:43:34.512149  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5321702.pem /etc/ssl/certs/3ec20f2e.0"

	I1203 02:43:34.522785  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1203 02:43:34.532648  668072 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:34.541026  668072 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec  3 02:10 /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:34.541108  668072 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:34.553376  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1203 02:43:34.567516  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/532170.pem && ln -fs /usr/share/ca-certificates/532170.pem /etc/ssl/certs/532170.pem"

	I1203 02:43:34.596882  668072 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/532170.pem

	I1203 02:43:34.603601  668072 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec  3 02:15 /usr/share/ca-certificates/532170.pem

	I1203 02:43:34.603663  668072 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/532170.pem

	I1203 02:43:34.614626  668072 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/532170.pem /etc/ssl/certs/51391683.0"

	I1203 02:43:34.629491  668072 kubeadm.go:390] StartCluster: {Name:running-upgrade-20211203024210-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:running-upgrade-20211203024210-532170 Namespace:default APIServerName:minikubeCA APIServerN

ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.70.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:34.629626  668072 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1203 02:43:34.629706  668072 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:34.650662  668072 cri.go:76] found id: "5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973"

	I1203 02:43:34.650691  668072 cri.go:76] found id: "9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762"

	I1203 02:43:34.650700  668072 cri.go:76] found id: "6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07"

	I1203 02:43:34.650707  668072 cri.go:76] found id: "3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150"

	I1203 02:43:34.650713  668072 cri.go:76] found id: "3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83"

	I1203 02:43:34.650722  668072 cri.go:76] found id: "91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55"

	I1203 02:43:34.650728  668072 cri.go:76] found id: ""

	I1203 02:43:34.650772  668072 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1203 02:43:34.709180  668072 cri.go:103] JSON = [{"ociVersion":"1.0.2-dev","id":"28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1","pid":1170,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1/rootfs","created":"2021-12-03T02:42:41.029147614Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-controller-manager-running-upgrade-20211203024210-532170_a3e7be694ef7cf952503c5d331abc0ac"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150","pid":1338,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8

s.io/3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150/rootfs","created":"2021-12-03T02:42:41.349208842Z","annotations":{"io.kubernetes.cri.container-name":"kube-controller-manager","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83","pid":1331,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83/rootfs","created":"2021-12-03T02:42:41.349360368Z","annotations":{"io.kubernetes.cri.container-name":"etcd","io.kubernetes.cri.container-type":"cont

ainer","io.kubernetes.cri.sandbox-id":"76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d","pid":1192,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d/rootfs","created":"2021-12-03T02:42:41.029239826Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-apiserver-running-upgrade-20211203024210-532170_1a3d0b2f75d3fe3cdcb430a4ec648e93"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973","pid":2245,"status":"running","bund

le":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973/rootfs","created":"2021-12-03T02:43:13.693697088Z","annotations":{"io.kubernetes.cri.container-name":"kindnet-cni","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f","pid":2101,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f/rootfs","created":"2021-12-03T02:43:12.865250874Z","annotations":{"io.kubernetes.cri.container-type":"sandbox"

,"io.kubernetes.cri.sandbox-id":"5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-proxy-s5dkz_37d60bad-5c96-4b5e-af37-35c412bd9bf9"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc","pid":2108,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc/rootfs","created":"2021-12-03T02:43:13.093813285Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kindnet-cdl8r_2c6eec38-4da1-42f0-94f4-3b85515c1b33"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"6d05d3967a23a4bcf794

ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07","pid":1344,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07/rootfs","created":"2021-12-03T02:42:41.349334443Z","annotations":{"io.kubernetes.cri.container-name":"kube-apiserver","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8","pid":1184,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8/rootfs","created":"202

1-12-03T02:42:41.029205316Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_etcd-running-upgrade-20211203024210-532170_1238d93130e438331f28fd7c6b49dcfe"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55","pid":1270,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55/rootfs","created":"2021-12-03T02:42:41.249525298Z","annotations":{"io.kubernetes.cri.container-name":"kube-scheduler","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3"},"owner":"root"},{"ociVe

rsion":"1.0.2-dev","id":"9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762","pid":2155,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762","rootfs":"/run/containerd/io.containerd.runtime.v2.task/k8s.io/9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762/rootfs","created":"2021-12-03T02:43:13.193423252Z","annotations":{"io.kubernetes.cri.container-name":"kube-proxy","io.kubernetes.cri.container-type":"container","io.kubernetes.cri.sandbox-id":"5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3","pid":1171,"status":"running","bundle":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3","rootfs":"/run/containerd/io.containerd.runtime.v1.linux/k8s.io/f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a2

2a6f26ede399b1d3/rootfs","created":"2021-12-03T02:42:40.989119063Z","annotations":{"io.kubernetes.cri.container-type":"sandbox","io.kubernetes.cri.sandbox-id":"f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3","io.kubernetes.cri.sandbox-log-directory":"/var/log/pods/kube-system_kube-scheduler-running-upgrade-20211203024210-532170_3478da2c440ba32fb6c087b3f3b99813"},"owner":"root"}]

	I1203 02:43:34.709415  668072 cri.go:113] list returned 12 containers

	I1203 02:43:34.709432  668072 cri.go:116] container: {ID:28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1 Status:running}

	I1203 02:43:34.709452  668072 cri.go:118] skipping 28974e8580a9584bc7d715dadac98ede462738786bbfc1a4e2443fdba230fdc1 - not in ps

	I1203 02:43:34.709457  668072 cri.go:116] container: {ID:3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150 Status:running}

	I1203 02:43:34.709464  668072 cri.go:122] skipping {3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150 running}: state = "running", want "paused"

	I1203 02:43:34.709482  668072 cri.go:116] container: {ID:3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83 Status:running}

	I1203 02:43:34.709488  668072 cri.go:122] skipping {3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83 running}: state = "running", want "paused"

	I1203 02:43:34.709493  668072 cri.go:116] container: {ID:4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d Status:running}

	I1203 02:43:34.709499  668072 cri.go:118] skipping 4865c1bdc03b18f2b5dbb5ab74c7fcd69002aa4b9ee61b2cca3a27b972fbc00d - not in ps

	I1203 02:43:34.709504  668072 cri.go:116] container: {ID:5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973 Status:running}

	I1203 02:43:34.709509  668072 cri.go:122] skipping {5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973 running}: state = "running", want "paused"

	I1203 02:43:34.709519  668072 cri.go:116] container: {ID:5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f Status:running}

	I1203 02:43:34.709530  668072 cri.go:118] skipping 5c52d4c8cd737710622428dc767794b9ef23c2b782f2c65bfd01f51fe186246f - not in ps

	I1203 02:43:34.709539  668072 cri.go:116] container: {ID:610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc Status:running}

	I1203 02:43:34.709544  668072 cri.go:118] skipping 610f8a3d0fb4917900aa2d23fc5aa807e42aa10a06e1a631c0662b55d79b59fc - not in ps

	I1203 02:43:34.709549  668072 cri.go:116] container: {ID:6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07 Status:running}

	I1203 02:43:34.709554  668072 cri.go:122] skipping {6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07 running}: state = "running", want "paused"

	I1203 02:43:34.709560  668072 cri.go:116] container: {ID:76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8 Status:running}

	I1203 02:43:34.709565  668072 cri.go:118] skipping 76bb99e7d73b2bb717d5abb8e1d85daed008553e9c54340f3ee448beb4a8a4b8 - not in ps

	I1203 02:43:34.709570  668072 cri.go:116] container: {ID:91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55 Status:running}

	I1203 02:43:34.709581  668072 cri.go:122] skipping {91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55 running}: state = "running", want "paused"

	I1203 02:43:34.709586  668072 cri.go:116] container: {ID:9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762 Status:running}

	I1203 02:43:34.709592  668072 cri.go:122] skipping {9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762 running}: state = "running", want "paused"

	I1203 02:43:34.709598  668072 cri.go:116] container: {ID:f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3 Status:running}

	I1203 02:43:34.709603  668072 cri.go:118] skipping f5225df1106de57aaffa296c3c74e7fe7633a0cc09f5a2a22a6f26ede399b1d3 - not in ps

	I1203 02:43:34.709655  668072 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1203 02:43:34.719919  668072 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I1203 02:43:34.719945  668072 kubeadm.go:600] restartCluster start

	I1203 02:43:34.719991  668072 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1203 02:43:34.728554  668072 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:34.729802  668072 kubeconfig.go:116] verify returned: extract IP: "running-upgrade-20211203024210-532170" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:34.730416  668072 kubeconfig.go:127] "running-upgrade-20211203024210-532170" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig - will repair!

	I1203 02:43:34.731444  668072 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig: {Name:mk08ee95b56499d1d159086ebdcfd257d76fd2de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:34.732836  668072 kapi.go:59] client config for running-upgrade-20211203024210-532170: &rest.Config{Host:"https://192.168.70.203:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/running-upgrade-20211203024210-532170/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/prof

iles/running-upgrade-20211203024210-532170/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15d5d20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1203 02:43:34.734631  668072 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1203 02:43:34.747005  668072 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-12-03 02:42:35.866933355 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-12-03 02:43:34.024920330 +0000

	@@ -65,4 +65,10 @@

	 apiVersion: kubeproxy.config.k8s.io/v1alpha1

	 kind: KubeProxyConfiguration

	 clusterCIDR: "10.244.0.0/16"

	-metricsBindAddress: 192.168.70.203:10249

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I1203 02:43:34.747031  668072 kubeadm.go:1032] stopping kube-system containers ...

	I1203 02:43:34.747049  668072 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}

	I1203 02:43:34.747104  668072 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:34.807068  668072 cri.go:76] found id: "5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973"

	I1203 02:43:34.807163  668072 cri.go:76] found id: "9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762"

	I1203 02:43:34.807179  668072 cri.go:76] found id: "6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07"

	I1203 02:43:34.807187  668072 cri.go:76] found id: "3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150"

	I1203 02:43:34.807193  668072 cri.go:76] found id: "3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83"

	I1203 02:43:34.807200  668072 cri.go:76] found id: "91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55"

	I1203 02:43:34.807206  668072 cri.go:76] found id: ""

	I1203 02:43:34.807230  668072 cri.go:220] Stopping containers: [5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973 9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762 6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07 3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150 3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83 91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55]

	I1203 02:43:34.807287  668072 ssh_runner.go:195] Run: which crictl

	I1203 02:43:34.811672  668072 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973 9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762 6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07 3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150 3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83 91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55

	I1203 02:43:36.735919  668072 ssh_runner.go:235] Completed: sudo /usr/bin/crictl stop 5bfc91d0abc995d6dc18a4c7d8e2877f80515c5db21c51e52a0210a322f17973 9eda31259c17de304d16a2792836a6c55e9cbcc826c1443405550732a2084762 6d05d3967a23a4bcf794ab5089e8b40c62644da2e1605aac8ae3ca537d8b5b07 3efa5df7e6ffe36363ea42fa54005f197854b1004a4b79dad02dee169790d150 3efaed998748ac8083faaaf942a73949c64ae41e90c702433fe8f2b6776abb83 91d876425693e2f185853a046d0eed0d5ed53f33a2aa7f56a686b9d9ddf66b55: (1.92415345s)

	I1203 02:43:36.735988  668072 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1203 02:43:36.754320  668072 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1203 02:43:36.761648  668072 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5611 Dec  3 02:42 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5630 Dec  3 02:42 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2087 Dec  3 02:42 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5578 Dec  3 02:42 /etc/kubernetes/scheduler.conf

	I1203 02:43:36.761712  668072 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1203 02:43:36.768798  668072 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1203 02:43:36.800541  668072 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1203 02:43:36.807639  668072 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:36.807701  668072 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1203 02:43:36.814416  668072 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1203 02:43:36.820791  668072 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:36.820835  668072 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1203 02:43:36.826980  668072 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:36.833802  668072 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:36.833824  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:34.906986  666582 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1203 02:43:34.907036  666582 addons.go:417] enableAddons completed in 676.680994ms

	I1203 02:43:34.914484  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:34.914512  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending

	I1203 02:43:34.914528  666582 retry.go:31] will retry after 338.212508ms: only 1 pod(s) have shown up

	I1203 02:43:35.256327  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:35.256361  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:35.256383  666582 retry.go:31] will retry after 378.459802ms: only 1 pod(s) have shown up

	I1203 02:43:35.639492  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:35.639523  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:35.639545  666582 retry.go:31] will retry after 469.882201ms: only 1 pod(s) have shown up

	I1203 02:43:36.113314  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:36.113348  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:36.113363  666582 retry.go:31] will retry after 667.365439ms: only 1 pod(s) have shown up

	I1203 02:43:36.783756  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:36.783786  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:36.783801  666582 retry.go:31] will retry after 597.243124ms: only 1 pod(s) have shown up

	I1203 02:43:37.396805  666582 system_pods.go:59] 1 kube-system pods found

	I1203 02:43:37.396837  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:37.396853  666582 retry.go:31] will retry after 789.889932ms: only 1 pod(s) have shown up

	I1203 02:43:38.191926  666582 system_pods.go:59] 5 kube-system pods found

	I1203 02:43:38.191960  666582 system_pods.go:61] "etcd-force-systemd-env-20211203024249-532170" [fd5bbbf6-80f0-422b-8752-45da1dd8f024] Pending

	I1203 02:43:38.191968  666582 system_pods.go:61] "kube-apiserver-force-systemd-env-20211203024249-532170" [fa948adb-1691-4745-ad20-b50cc3e1aa93] Pending

	I1203 02:43:38.191975  666582 system_pods.go:61] "kube-controller-manager-force-systemd-env-20211203024249-532170" [fbed9adc-0bff-4c63-bd9d-c5a44969a386] Pending

	I1203 02:43:38.191981  666582 system_pods.go:61] "kube-scheduler-force-systemd-env-20211203024249-532170" [878b4e97-c8b2-45cf-9e3c-23256ec466c5] Pending

	I1203 02:43:38.191990  666582 system_pods.go:61] "storage-provisioner" [b8977de4-70a3-483c-bd8d-d302bb3b1da4] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I1203 02:43:38.191996  666582 system_pods.go:74] duration metric: took 3.596237176s to wait for pod list to return data ...

	I1203 02:43:38.192010  666582 kubeadm.go:547] duration metric: took 3.96174082s to wait for : map[apiserver:true system_pods:true] ...

	I1203 02:43:38.192029  666582 node_conditions.go:102] verifying NodePressure condition ...

	I1203 02:43:38.196020  666582 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I1203 02:43:38.196057  666582 node_conditions.go:123] node cpu capacity is 8

	I1203 02:43:38.196070  666582 node_conditions.go:105] duration metric: took 4.036351ms to run NodePressure ...

	I1203 02:43:38.196084  666582 start.go:234] waiting for startup goroutines ...

	I1203 02:43:38.270369  666582 start.go:486] kubectl: 1.20.5, cluster: 1.22.4 (minor skew: 2)

	I1203 02:43:38.272570  666582 out.go:176]

	W1203 02:43:38.272756  666582 out.go:241] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.4.

	I1203 02:43:38.274432  666582 out.go:176]   - Want kubectl v1.22.4? Try 'minikube kubectl -- get pods -A'

	I1203 02:43:38.276164  666582 out.go:176] * Done! kubectl is now configured to use "force-systemd-env-20211203024249-532170" cluster and "default" namespace by default

	I1203 02:43:36.079728  670481 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images import /var/lib/minikube/images/dashboard_v2.3.1: (3.283005887s)

	I1203 02:43:36.079760  670481 cache_images.go:310] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.3.1 from cache

	I1203 02:43:36.079793  670481 cache_images.go:118] Successfully loaded all cached images

	I1203 02:43:36.079800  670481 cache_images.go:87] LoadImages completed in 11.951179954s

	I1203 02:43:36.079845  670481 ssh_runner.go:195] Run: sudo crictl info

	I1203 02:43:36.095312  670481 cni.go:93] Creating CNI manager for ""

	I1203 02:43:36.095336  670481 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:43:36.095357  670481 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1203 02:43:36.095394  670481 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.59.203 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-20211203024124-532170 NodeName:stopped-upgrade-20211203024124-532170 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.59.203"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.59.203 CgroupDrive

r:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1203 02:43:36.095576  670481 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.59.203

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "stopped-upgrade-20211203024124-532170"

	  kubeletExtraArgs:

	    node-ip: 192.168.59.203

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.59.203"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1203 02:43:36.095682  670481 kubeadm.go:909] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cni-conf-dir=/etc/cni/net.mk --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=stopped-upgrade-20211203024124-532170 --image-service-endpoint=unix:///run/containerd/containerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.59.203 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1203 02:43:36.095744  670481 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I1203 02:43:36.104381  670481 binaries.go:44] Found k8s binaries, skipping transfer

	I1203 02:43:36.104549  670481 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1203 02:43:36.113812  670481 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (584 bytes)

	I1203 02:43:36.128262  670481 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1203 02:43:36.142835  670481 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2093 bytes)

	I1203 02:43:36.159567  670481 ssh_runner.go:195] Run: grep 192.168.59.203	control-plane.minikube.internal$ /etc/hosts

	I1203 02:43:36.162918  670481 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.59.203	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1203 02:43:36.172696  670481 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170 for IP: 192.168.59.203

	I1203 02:43:36.172822  670481 certs.go:182] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key

	I1203 02:43:36.172875  670481 certs.go:182] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key

	I1203 02:43:36.172972  670481 certs.go:298] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/client.key

	I1203 02:43:36.173042  670481 certs.go:298] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/apiserver.key.8add1ec7

	I1203 02:43:36.173093  670481 certs.go:298] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/proxy-client.key

	I1203 02:43:36.173211  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem (1338 bytes)

	W1203 02:43:36.173251  670481 certs.go:384] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170_empty.pem, impossibly tiny 0 bytes

	I1203 02:43:36.173264  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca-key.pem (1675 bytes)

	I1203 02:43:36.173303  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/ca.pem (1082 bytes)

	I1203 02:43:36.173336  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/cert.pem (1123 bytes)

	I1203 02:43:36.173366  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/key.pem (1675 bytes)

	I1203 02:43:36.173420  670481 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem (1708 bytes)

	I1203 02:43:36.174540  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1203 02:43:36.191740  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1203 02:43:36.213882  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1203 02:43:36.234999  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1203 02:43:36.256375  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1203 02:43:36.276117  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1203 02:43:36.294084  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1203 02:43:36.314518  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1203 02:43:36.334187  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/ssl/certs/5321702.pem --> /usr/share/ca-certificates/5321702.pem (1708 bytes)

	I1203 02:43:36.355493  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1203 02:43:36.372870  670481 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/certs/532170.pem --> /usr/share/ca-certificates/532170.pem (1338 bytes)

	I1203 02:43:36.389809  670481 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1203 02:43:36.405485  670481 ssh_runner.go:195] Run: openssl version

	I1203 02:43:36.411287  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5321702.pem && ln -fs /usr/share/ca-certificates/5321702.pem /etc/ssl/certs/5321702.pem"

	I1203 02:43:36.420249  670481 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5321702.pem

	I1203 02:43:36.424172  670481 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Dec  3 02:15 /usr/share/ca-certificates/5321702.pem

	I1203 02:43:36.424235  670481 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5321702.pem

	I1203 02:43:36.430168  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5321702.pem /etc/ssl/certs/3ec20f2e.0"

	I1203 02:43:36.438801  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1203 02:43:36.448671  670481 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:36.452884  670481 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Dec  3 02:10 /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:36.452956  670481 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1203 02:43:36.459290  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1203 02:43:36.466947  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/532170.pem && ln -fs /usr/share/ca-certificates/532170.pem /etc/ssl/certs/532170.pem"

	I1203 02:43:36.474841  670481 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/532170.pem

	I1203 02:43:36.478315  670481 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Dec  3 02:15 /usr/share/ca-certificates/532170.pem

	I1203 02:43:36.478381  670481 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/532170.pem

	I1203 02:43:36.483853  670481 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/532170.pem /etc/ssl/certs/51391683.0"

	I1203 02:43:36.493552  670481 kubeadm.go:390] StartCluster: {Name:stopped-upgrade-20211203024124-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.15-snapshot4@sha256:ef1f485b5a1cfa4c989bc05e153f0a8525968ec999e242efff871cbb31649c16 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:stopped-upgrade-20211203024124-532170 Namespace:default APIServerName:minikubeCA APIServerN

ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.59.203 Port:8443 KubernetesVersion:v1.20.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:}

	I1203 02:43:36.493685  670481 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1203 02:43:36.493745  670481 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:36.514718  670481 cri.go:76] found id: "83907c102f71e793dcb1372052002cd8b9ea48c6b8ed751f5464e2bf6dbdd04d"

	I1203 02:43:36.514748  670481 cri.go:76] found id: "4ae964461ba3c2d025d571ce98d6884655c7960bac0436a319531abe60a1c2df"

	I1203 02:43:36.514756  670481 cri.go:76] found id: "5b7e7225b1d99eaa56a8052b5258e832f7a8622b19d4b69637b332b7821b77df"

	I1203 02:43:36.514764  670481 cri.go:76] found id: "97fd18d75c2d98f248812a3bf8aa87e07763b42dad0debafe3bc484331a38e09"

	I1203 02:43:36.514771  670481 cri.go:76] found id: ""

	I1203 02:43:36.514843  670481 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1203 02:43:36.534260  670481 cri.go:103] JSON = null

	W1203 02:43:36.534322  670481 kubeadm.go:397] unpause failed: list paused: list returned 0 containers, but ps returned 4

	I1203 02:43:36.534380  670481 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1203 02:43:36.543277  670481 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I1203 02:43:36.543363  670481 kubeadm.go:600] restartCluster start

	I1203 02:43:36.543423  670481 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1203 02:43:36.551777  670481 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:36.552984  670481 kubeconfig.go:116] verify returned: extract IP: "stopped-upgrade-20211203024124-532170" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:43:36.553431  670481 kubeconfig.go:127] "stopped-upgrade-20211203024124-532170" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig - will repair!

	I1203 02:43:36.554183  670481 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig: {Name:mk08ee95b56499d1d159086ebdcfd257d76fd2de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:43:36.556391  670481 kapi.go:59] client config for stopped-upgrade-20211203024124-532170: &rest.Config{Host:"https://192.168.59.203:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/stopped-upgrade-20211203024124-532170/client.crt", KeyFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/prof

iles/stopped-upgrade-20211203024124-532170/client.key", CAFile:"/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15d5d20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1203 02:43:36.557932  670481 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1203 02:43:36.565433  670481 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-12-03 02:42:40.331392940 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-12-03 02:43:36.153139416 +0000

	@@ -65,4 +65,10 @@

	 apiVersion: kubeproxy.config.k8s.io/v1alpha1

	 kind: KubeProxyConfiguration

	 clusterCIDR: "10.244.0.0/16"

	-metricsBindAddress: 192.168.59.203:10249

	+metricsBindAddress: 0.0.0.0:10249

	+conntrack:

	+  maxPerCore: 0

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	+  tcpEstablishedTimeout: 0s

	+# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	+  tcpCloseWaitTimeout: 0s

	-- /stdout --

	I1203 02:43:36.565452  670481 kubeadm.go:1032] stopping kube-system containers ...

	I1203 02:43:36.565466  670481 cri.go:41] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}

	I1203 02:43:36.565508  670481 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1203 02:43:36.581423  670481 cri.go:76] found id: "83907c102f71e793dcb1372052002cd8b9ea48c6b8ed751f5464e2bf6dbdd04d"

	I1203 02:43:36.581450  670481 cri.go:76] found id: "4ae964461ba3c2d025d571ce98d6884655c7960bac0436a319531abe60a1c2df"

	I1203 02:43:36.581456  670481 cri.go:76] found id: "5b7e7225b1d99eaa56a8052b5258e832f7a8622b19d4b69637b332b7821b77df"

	I1203 02:43:36.581462  670481 cri.go:76] found id: "97fd18d75c2d98f248812a3bf8aa87e07763b42dad0debafe3bc484331a38e09"

	I1203 02:43:36.581466  670481 cri.go:76] found id: ""

	I1203 02:43:36.581472  670481 cri.go:220] Stopping containers: [83907c102f71e793dcb1372052002cd8b9ea48c6b8ed751f5464e2bf6dbdd04d 4ae964461ba3c2d025d571ce98d6884655c7960bac0436a319531abe60a1c2df 5b7e7225b1d99eaa56a8052b5258e832f7a8622b19d4b69637b332b7821b77df 97fd18d75c2d98f248812a3bf8aa87e07763b42dad0debafe3bc484331a38e09]

	I1203 02:43:36.581520  670481 ssh_runner.go:195] Run: which crictl

	I1203 02:43:36.585053  670481 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop 83907c102f71e793dcb1372052002cd8b9ea48c6b8ed751f5464e2bf6dbdd04d 4ae964461ba3c2d025d571ce98d6884655c7960bac0436a319531abe60a1c2df 5b7e7225b1d99eaa56a8052b5258e832f7a8622b19d4b69637b332b7821b77df 97fd18d75c2d98f248812a3bf8aa87e07763b42dad0debafe3bc484331a38e09

	I1203 02:43:36.601745  670481 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1203 02:43:36.613897  670481 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1203 02:43:36.622322  670481 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5615 Dec  3 02:42 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5630 Dec  3 02:42 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2087 Dec  3 02:43 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5582 Dec  3 02:42 /etc/kubernetes/scheduler.conf

	I1203 02:43:36.622397  670481 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1203 02:43:36.630864  670481 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1203 02:43:36.641462  670481 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1203 02:43:36.650563  670481 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:36.650627  670481 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1203 02:43:36.658604  670481 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1203 02:43:36.665824  670481 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1203 02:43:36.665877  670481 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1203 02:43:36.672567  670481 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:36.679701  670481 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1203 02:43:36.679729  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:36.755262  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.113845  670481 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.358547681s)

	I1203 02:43:38.113876  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.290027  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.406967  670481 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.493001  670481 api_server.go:51] waiting for apiserver process to appear ...

	I1203 02:43:38.493068  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:39.009435  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:39.509920  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:36.894838  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:37.859414  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.021189  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.131400  668072 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1203 02:43:38.214716  668072 api_server.go:51] waiting for apiserver process to appear ...

	I1203 02:43:38.214789  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:38.742136  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:39.241834  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:39.742435  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:40.242274  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:40.741680  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:41.242504  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:41.741665  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:40.009207  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:40.509648  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:41.009894  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:41.509297  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:42.009058  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:42.509385  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:43.009457  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:43.509052  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:44.009266  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:44.509819  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:42.242285  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:42.742113  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:43.241791  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:43.742221  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:44.242361  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:44.741860  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:45.242550  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:45.741936  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:46.242512  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:46.741848  668072 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:45.009034  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:47.009949  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:47.509430  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:48.009222  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:48.509901  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:49.009834  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:43:49.509934  670481 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	44ad2903327a4       6e38f40d628db       59 seconds ago       Running             storage-provisioner       0                   9d44abe734bc7

	fa412d0bc64fe       8d147537fb7d1       About a minute ago   Running             coredns                   0                   989b0a20cd6bf

	9fe05a46928d7       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   52fd468fab925

	b96a30f689aa8       edeff87e48029       About a minute ago   Running             kube-proxy                0                   1150dc7540b90

	da77c4c16ea38       0ce02f92d3e43       About a minute ago   Running             kube-controller-manager   0                   75715f0308eb1

	377954dfce779       721ba97f54a65       About a minute ago   Running             kube-scheduler            0                   4b59fc65934a4

	c6bb5925aa26b       0048118155842       About a minute ago   Running             etcd                      0                   26442a09720c6

	7861cc2da74e1       8a5cc299272d9       About a minute ago   Running             kube-apiserver            0                   1a438759f3a6e

	* ==> containerd <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:43:51 UTC. --

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222703254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222716851Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222726647Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222848435Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222920521Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc00041ffb0 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:true} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugin

ConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223014188Z" level=info msg="Connect containerd service"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223064254Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223824728Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223940610Z" level=info msg="Start subscribing containerd event"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224031243Z" level=info msg="Start recovering state"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224569581Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224644393Z" level=info msg=serving... address=/run/containerd/containerd.sock

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224702180Z" level=info msg="containerd successfully booted in 0.040989s"

	Dec 03 02:42:38 pause-20211203024124-532170 systemd[1]: Started containerd container runtime.

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310686273Z" level=info msg="Start event monitor"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310736093Z" level=info msg="Start snapshots syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310744594Z" level=info msg="Start cni network conf syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310757514Z" level=info msg="Start streaming server"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.156621095Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.186943591Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f pid=2529

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.361766697Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,} returns sandbox id \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.365150740Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.436686048Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.437875321Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.586425386Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\" returns successfully"

	* ==> coredns [fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	W1203 02:43:19.553172       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553228       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Namespace ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553214       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	I1203 02:43:30.407345       1 trace.go:205] Trace[336122540]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.405) (total time: 10001ms):

	Trace[336122540]: [10.001491184s] [10.001491184s] END

	E1203 02:43:30.407394       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=505": net/http: TLS handshake timeout

	I1203 02:43:30.693805       1 trace.go:205] Trace[646203300]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.693) (total time: 10000ms):

	Trace[646203300]: [10.000566421s] [10.000566421s] END

	E1203 02:43:30.693839       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=286": net/http: TLS handshake timeout

	I1203 02:43:30.903614       1 trace.go:205] Trace[1747278511]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.902) (total time: 10000ms):

	Trace[1747278511]: [10.000749713s] [10.000749713s] END

	E1203 02:43:30.903650       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=210": net/http: TLS handshake timeout

	* ==> describe nodes <==

	* ==> dmesg <==

	* [  +0.000002] ll header: 00000000: ff ff ff ff ff ff de 19 e6 42 b4 2c 08 06        .........B.,..

	[Dec 3 02:35] cgroup: cgroup2: unknown option "nsdelegate"

	[ +43.145422] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.997001] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethae8775a3

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 09 60 d3 6c 6f 08 06        ........`.lo..

	[Dec 3 02:36] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:38] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc07b7bb4

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 9a 08 d6 d0 27 5c 08 06        ..........'\..

	[Dec 3 02:39] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:40] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth5d5f7a44

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 9e b4 3b e2 7b 9d 08 06        ........;.{...

	[Dec 3 02:41] cgroup: cgroup2: unknown option "nsdelegate"

	[ +14.204723] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.025718] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.991957] cgroup: cgroup2: unknown option "nsdelegate"

	[ +19.678388] cgroup: cgroup2: unknown option "nsdelegate"

	[  +2.060023] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:42] cgroup: cgroup2: unknown option "nsdelegate"

	[ +13.603429] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth170a53a8

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 4a 38 90 3b cc 08 06        .......J8.;...

	[  +9.575101] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethe30be4e2

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa eb 14 cd 69 e4 08 06        ..........i...

	[  +9.369686] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:43] cgroup: cgroup2: unknown option "nsdelegate"

	[ +44.054897] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83] <==

	* {"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[615955715] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"1.188717958s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[615955715] 'read index received'  (duration: 968.013476ms)","trace[615955715] 'applied index is now lower than readState.Index'  (duration: 220.703541ms)"],"step_count":2}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1851729177] transaction","detail":"{read_only:false; response_revision:530; number_of_response:1; }","duration":"1.582656878s","start":"2021-12-03T02:42:53.270Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1851729177] 'compare'  (duration: 1.582261694s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.613711605s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.188840443s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1129"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[43474745] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:530; }","duration":"1.188875717s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[43474745] 'agreement among raft nodes before linearized reading'  (duration: 1.188815061s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1805756956] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:529; }","duration":"1.613993557s","start":"2021-12-03T02:42:53.238Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1805756956] 'range keys from in-memory index tree'  (duration: 1.61359796s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.664Z","time spent":"1.188915825s","remote":"127.0.0.1:33864","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1153,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.238Z","time spent":"1.614050289s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.853Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.270Z","time spent":"1.582731298s","remote":"127.0.0.1:33918","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":598,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >"}

	{"level":"warn","ts":"2021-12-03T02:42:55.362Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:55.862Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.363Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.800Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.939127407s","expected-duration":"1s"}

	{"level":"info","ts":"2021-12-03T02:42:56.800Z","caller":"traceutil/trace.go:171","msg":"trace[121078242] linearizableReadLoop","detail":"{readStateIndex:549; appliedIndex:549; }","duration":"1.939141286s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.800Z","steps":["trace[121078242] 'read index received'  (duration: 1.939133379s)","trace[121078242] 'applied index is now lower than readState.Index'  (duration: 6.677µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.953947612s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/kubernetes\" ","response":"range_response_count:1 size:706"}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.95289822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[634251822] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:531; }","duration":"1.953003147s","start":"2021-12-03T02:42:54.862Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[634251822] 'agreement among raft nodes before linearized reading'  (duration: 1.938259419s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[1182520940] range","detail":"{range_begin:/registry/services/specs/default/kubernetes; range_end:; response_count:1; response_revision:531; }","duration":"1.954019471s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[1182520940] 'agreement among raft nodes before linearized reading'  (duration: 1.93925253s)","trace[1182520940] 'range keys from in-memory index tree'  (duration: 14.649038ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.862Z","time spent":"1.953050451s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.861Z","time spent":"1.954077543s","remote":"127.0.0.1:33880","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":1,"response size":730,"request content":"key:\"/registry/services/specs/default/kubernetes\" "}

	{"level":"warn","ts":"2021-12-03T02:43:46.685Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100374,"retry-timeout":"500ms"}

	{"level":"info","ts":"2021-12-03T02:43:46.909Z","caller":"traceutil/trace.go:171","msg":"trace[1485506552] linearizableReadLoop","detail":"{readStateIndex:584; appliedIndex:584; }","duration":"724.853451ms","start":"2021-12-03T02:43:46.184Z","end":"2021-12-03T02:43:46.909Z","steps":["trace[1485506552] 'read index received'  (duration: 724.832693ms)","trace[1485506552] 'applied index is now lower than readState.Index'  (duration: 19.03µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:43:48.022Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.837689726s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true ","response":"range_response_count:0 size:7"}

	{"level":"info","ts":"2021-12-03T02:43:48.022Z","caller":"traceutil/trace.go:171","msg":"trace[27281358] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:0; response_revision:563; }","duration":"1.837795746s","start":"2021-12-03T02:43:46.184Z","end":"2021-12-03T02:43:48.022Z","steps":["trace[27281358] 'agreement among raft nodes before linearized reading'  (duration: 724.968239ms)","trace[27281358] 'count revisions from in-memory index tree'  (duration: 1.112693635s)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:43:48.022Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:43:46.184Z","time spent":"1.837855604s","remote":"127.0.0.1:33908","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":1,"response size":31,"request content":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true "}

	* ==> kernel <==

	*  02:44:01 up  4:26,  0 users,  load average: 8.04, 4.48, 2.40

	Linux pause-20211203024124-532170 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4] <==

	* k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1(0x7f4e242dede8, 0xc000acd840, 0xc00b36cb00)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:80 +0x75c

	net/http.HandlerFunc.ServeHTTP(0xc007fbfa40, 0x7f4e242dede8, 0xc000acd840, 0xc00b36c900)

		/usr/local/go/src/net/http/server.go:2049 +0x44

	k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1(0x7f4e242dede8, 0xc000acd840, 0xc00b36c800)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filterlatency/filterlatency.go:88 +0x38c

	net/http.HandlerFunc.ServeHTTP(0xc007fc0840, 0x7f4e242dede8, 0xc000acd840, 0xc00b36c800)

		/usr/local/go/src/net/http/server.go:2049 +0x44

	k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc00d15efc0, 0xc0049b58f0, 0x56b5388, 0xc000acd840, 0xc00b36c800)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:108 +0xb8

	created by k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:94 +0x1fa

	I1203 02:43:39.273452       1 trace.go:205] Trace[718628182]: "Get" url:/api/v1/namespaces/default/services/kubernetes,user-agent:kube-apiserver/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:54fa5833-84a5-4ef6-ba03-68c014be0808,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:54.861) (total time: 44412ms):

	Trace[718628182]: ---"About to write a response" 44412ms (02:43:39.273)

	Trace[718628182]: [44.412077247s] [44.412077247s] END

	E1203 02:43:39.273682       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E1203 02:43:39.273737       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E1203 02:43:39.273751       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1203 02:43:39.274119       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E1203 02:43:39.274156       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E1203 02:43:39.274763       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1203 02:43:39.275803       1 timeout.go:135] post-timeout activity - time-elapsed: 2.689165ms, GET "/api" result: <nil>

	E1203 02:43:39.284652       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1203 02:43:39.288684       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1203 02:43:39.292681       1 timeout.go:135] post-timeout activity - time-elapsed: 19.434706ms, GET "/api" result: <nil>

	* ==> kube-controller-manager [da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd] <==

	* I1203 02:42:19.698168       1 shared_informer.go:247] Caches are synced for PV protection

	I1203 02:42:19.698204       1 shared_informer.go:247] Caches are synced for expand

	I1203 02:42:19.723295       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5xmj2"

	I1203 02:42:19.723336       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-n6hkm"

	I1203 02:42:19.723690       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1203 02:42:19.800345       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:19.829969       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-qwmpd"

	I1203 02:42:20.016290       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1203 02:42:20.026075       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:20.097398       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177064       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177104       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1203 02:42:34.546360       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	E1203 02:43:35.121711       1 resource_quota_controller.go:413] failed to discover resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	W1203 02:43:35.121726       1 garbagecollector.go:705] failed to discover preferred resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	I1203 02:43:39.904957       1 event.go:291] "Event occurred" object="pause-20211203024124-532170" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node pause-20211203024124-532170 status is now: NodeNotReady"

	I1203 02:43:39.910589       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978-qwmpd" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.916423       1 event.go:291] "Event occurred" object="kube-system/storage-provisioner" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.922264       1 event.go:291] "Event occurred" object="kube-system/etcd-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.926938       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.931619       1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.935422       1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.996769       1 event.go:291] "Event occurred" object="kube-system/kindnet-n6hkm" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:40.004161       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I1203 02:43:40.004423       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-5xmj2" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	* ==> kube-proxy [b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf] <==

	* I1203 02:42:20.634200       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1203 02:42:20.634302       1 server_others.go:140] Detected node IP 192.168.49.2

	W1203 02:42:20.634321       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1203 02:42:21.018258       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1203 02:42:21.018308       1 server_others.go:212] Using iptables Proxier.

	I1203 02:42:21.018322       1 server_others.go:219] creating dualStackProxier for iptables.

	W1203 02:42:21.018342       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1203 02:42:21.018662       1 server.go:649] Version: v1.22.4

	I1203 02:42:21.020100       1 config.go:224] Starting endpoint slice config controller

	I1203 02:42:21.020120       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1203 02:42:21.020193       1 config.go:315] Starting service config controller

	I1203 02:42:21.020198       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1203 02:42:21.121119       1 shared_informer.go:247] Caches are synced for service config

	I1203 02:42:21.121195       1 shared_informer.go:247] Caches are synced for endpoint slice config

	* ==> kube-scheduler [377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac] <==

	* W1203 02:42:03.294201       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1203 02:42:03.406171       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1203 02:42:03.406300       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1203 02:42:03.406324       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1203 02:42:03.406344       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1203 02:42:03.407679       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1203 02:42:03.415896       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1203 02:42:03.416427       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.418623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1203 02:42:03.421833       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1203 02:42:03.422567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1203 02:42:03.422726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.422862       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1203 02:42:03.423000       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:03.423347       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423470       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423544       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1203 02:42:03.423558       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:03.423644       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1203 02:42:03.424827       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1203 02:42:04.333813       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:04.364124       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:04.365071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:04.472526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I1203 02:42:04.906826       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:44:01 UTC. --

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --network-plugin has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --runtime-request-timeout has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --cni-conf-dir has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --network-plugin has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --runtime-request-timeout has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.665053    3719 server.go:440] "Kubelet version" kubeletVersion="v1.22.4"

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.665515    3719 server.go:868] "Client rotation is on, will bootstrap in background"

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.694363    3719 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.695767    3719 dynamic_cafile_content.go:155] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 03 02:43:40 pause-20211203024124-532170 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 03 02:43:40 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:40.141519    3719 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706117    3719 server.go:687] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706429    3719 container_manager_linux.go:280] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706502    3719 container_manager_linux.go:285] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerPolicyOptions:map[] ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706553    3719 topology_manager.go:133] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706568    3719 container_manager_linux.go:320] "Creating device plugin manager" devicePluginEnabled=true

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706608    3719 state_mem.go:36] "Initialized new in-memory state store"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706949    3719 kubelet.go:418] "Attempting to sync node with API server"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706982    3719 kubelet.go:279] "Adding static pod path" path="/etc/kubernetes/manifests"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.707012    3719 kubelet.go:290] "Adding apiserver pod source"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.707042    3719 apiserver.go:42] "Waiting for node sync before watching apiserver pods"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.711318    3719 kuberuntime_manager.go:245] "Container runtime initialized" containerRuntime="containerd" version="1.4.9" apiVersion="v1alpha2"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.712766    3719 server.go:1213] "Started kubelet"

	Dec 03 02:43:44 pause-20211203024124-532170 systemd[1]: kubelet.service: Succeeded.

	Dec 03 02:43:44 pause-20211203024124-532170 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8] <==

	* I1203 02:42:51.601493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1203 02:42:51.615295       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1203 02:42:51.615709       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1203 02:42:51.641608       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1203 02:42:51.641868       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

	I1203 02:42:51.643094       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbc908e7-bac3-41f4-ad8a-28a0acbab933", APIVersion:"v1", ResourceVersion:"527", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d became leader

	I1203 02:42:51.742125       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

-- /stdout --

** stderr **

	E1203 02:44:01.365084  677760 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (461.682568ms)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211203024124-532170" apiserver is not running, skipping kubectl commands (state="Paused")

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20211203024124-532170

helpers_test.go:236: (dbg) docker inspect pause-20211203024124-532170:

-- stdout --

	        "Id": "2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc",

	        "Created": "2021-12-03T02:41:26.275196666Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 651787,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-12-03T02:41:27.094995507Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hostname",

	        "HostsPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/hosts",

	        "LogPath": "/var/lib/docker/containers/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc/2fc356be3f9aeb37d7f720969ef19bf8110acac88780406b5d2bec139f1913fc-json.log",

	        "Name": "/pause-20211203024124-532170",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20211203024124-532170:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20211203024124-532170",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf-init/diff:/var/lib/docker/overlay2/6ac4080541cfeacde0b54b862ed3e8c1497bf3d3f22b73f3dd4ce1f668e19c72/diff:/var/lib/docker/overlay2/3e23ff251c4a4f7c2bc4e503098b4a2c6cc61a1d99b51a599fab585fe722bb1b/diff:/var/lib/docker/overlay2/cc6e93735a0ca1de72f287a78429adcbf52754f7b56e82fd10136b36df126cb7/diff:/var/lib/docker/overlay2/9b91525d2aa18b23a08318fd216cf0dd395530e8ee0971ef4ee837687f222c44/diff:/var/lib/docker/overlay2/afd7645dd1e3de615d5e6b8e38717640c35dd9d0dbad5d79e1e72c29f519e047/diff:/var/lib/docker/overlay2/e42185b4ffd5fd72d5dd3032240c65ebde359f8e05c73af3d0187f32c837a786/diff:/var/lib/docker/overlay2/fc00a8e7d591e187ad76a50b07d8c5a06e15c107d4f840ccea15b68e28da1980/diff:/var/lib/docker/overlay2/a29bf1481ece426838b6a498b3effdf9ff07fce93c547917247a80b257a1fe6a/diff:/var/lib/docker/overlay2/d08861a8de693171af3100608e63638de0eff4ee0ab9dad23a141b63c9fc78ba/diff:/var/lib/docker/overlay2/a810fd

33b8bdb6290817982a645db1f3f53d332f221af803394694d926de6ca1/diff:/var/lib/docker/overlay2/82d5a8bdd562d849d98ab607f16a3a733ccc7b8f078412597b1324d4fadd3be1/diff:/var/lib/docker/overlay2/1a93d862337e75ae7f4350d3b11066c9de4c24aceee76546de610057f617281d/diff:/var/lib/docker/overlay2/016cb2f9bec981cb59ea9c574c581bad8e88da405748168504b409ab365eb79b/diff:/var/lib/docker/overlay2/83e41d3d061b2ae009fb28d0223691d1ec84632e4b835f49eec164d4466dae2d/diff:/var/lib/docker/overlay2/0ce62a53786be1b733f4d9a3f0bb5d6eddb1df23134f5b87286ea0a0cf9fbbf0/diff:/var/lib/docker/overlay2/c13141fe83f4579fcc3d40c499982793faebda827f5ca6cc5534911b1ec393f6/diff:/var/lib/docker/overlay2/55fce7735b2305346d30a554960b07ae732bacdfbc399692dd2506c80daf9877/diff:/var/lib/docker/overlay2/252a160a3b32162d3ff13c40ccc33cabd273340235797ebee736493a1029eda7/diff:/var/lib/docker/overlay2/fce6704ef3f6cc37735e8972372e0f5e0bfbf4af83f5ff6fd027e174c59578e0/diff:/var/lib/docker/overlay2/88c75fcb26b5194e243c651225b00fb638c5ea62eb979d7df5b728df5ef5195a/diff:/var/lib/d

ocker/overlay2/0771e6e29be058dc4b8a5521020f5d66e3e4f0996747baea7cb18371e3545b6b/diff:/var/lib/docker/overlay2/9b15999e93e34bb79fccce68ef9de2dfe1780f1d4c0595f52d15981d7090babb/diff:/var/lib/docker/overlay2/8fd40ec7570ab0690e15c09834e3bc5284b3badf0f5b98cf234cc063d023fbce/diff:/var/lib/docker/overlay2/317d010d230847ac38e52570cb1bf66b55a735ba2fcd26045ca1d928fee269e9/diff:/var/lib/docker/overlay2/9e0744f6558a5e30811c7bc770686bb03018000ec5504f0a7342d648858c6520/diff:/var/lib/docker/overlay2/2b1e4978e05c0bbd41e0db471a4546b47e88d4d07bba062e641ee19252fbe324/diff:/var/lib/docker/overlay2/8a5ad66f897aa93b3a59cb81de4d6f3a4437cdf29b1daaac0470479e0627d353/diff:/var/lib/docker/overlay2/4c73a8fc02a1854c714f156081c2ed75e595e3dde9226820f21ff9353b52fbb7/diff:/var/lib/docker/overlay2/be02751327b17c0e71631c5e6cbea324ca807f35ff112d906955328aabd427d8/diff:/var/lib/docker/overlay2/500480e16cba6dcc737fbaabcd657d62a6d877b3505eec63f1de6e5e3c9dbb92/diff:/var/lib/docker/overlay2/2cd99ae5cfb49d19c25b95ac17d84a6889e691672d6d93a9f066ca8b7c4

5289f/diff:/var/lib/docker/overlay2/bc1787830a034113efe9235ddf0dc8652dfff6e7926a63d839120bbe9ebc0b99/diff:/var/lib/docker/overlay2/44149fe8e3297368fee684058e3d52cef2712454b3145aa883bcb63bbae8542f/diff:/var/lib/docker/overlay2/433b47ea5ada41625d6479daf7944dc706ab5abbcad92f65a32b40a754cbf645/diff:/var/lib/docker/overlay2/77082cd9d165ff33aaddc632231ac2ea8dc30f9073037fc9c3c97f50db12d5b2/diff:/var/lib/docker/overlay2/631d81e1d8b807f0a941170215bfd43566c2823909251d69246f84dc74dff425/diff:/var/lib/docker/overlay2/6eb234f85614a81f5323a7f51a68384027e94afd402c9851374d990371ebf594/diff:/var/lib/docker/overlay2/8c188ae964eaa37da1b63d82bc30f6d81e8a06ee2c1af3f12719f9cf443b6e09/diff:/var/lib/docker/overlay2/86d4eaadf1b0680172d06e3118a53a77440af3c8e5bde8c29bb97e7f94599244/diff:/var/lib/docker/overlay2/78fadeb69e3f7825d1bad64e2e686eff962fc4ed859de8fd0d2b2d30d56510a1/diff",

	                "MergedDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/merged",

	                "UpperDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/diff",

	                "WorkDir": "/var/lib/docker/overlay2/7b5a1f59d5810bced6fa94f13fccc8233a0a812da9bb925602d8108fc5966bbf/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20211203024124-532170",

	                "Source": "/var/lib/docker/volumes/pause-20211203024124-532170/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20211203024124-532170",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "name.minikube.sigs.k8s.io": "pause-20211203024124-532170",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c1242b1b033f16bedee595a0280553c95576e94729234572b5dbfcbd58cee8ec",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33286"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33285"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33282"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33284"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33283"

},

	            "SandboxKey": "/var/run/docker/netns/c1242b1b033f",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20211203024124-532170": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "2fc356be3f9a"

],

	                    "NetworkID": "da1d0795a7d3bb5f007c696fba96d61b49ce95f6e99122ac37e1226dd45b8f38",

	                    "EndpointID": "59b7bb705dfc9e261679395a707aa0e1863d48a4a93f55f99fdcc3b7f3f19ed3",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (469.830925ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p pause-20211203024124-532170 logs -n 25: (11.117039947s)

helpers_test.go:253: TestPause/serial/PauseAgain logs:

-- stdout --

	* ==> Audit <==

	* |---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                   Args                   |                 Profile                  |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| start   | -p                                       | NoKubernetes-20211203024124-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:41:32 UTC |

	|         | NoKubernetes-20211203024124-532170       |                                          |         |         |                               |                               |

	|         | --no-kubernetes --driver=docker          |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| profile | list                                     | minikube                                 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:33 UTC |

	| profile | list --output=json                       | minikube                                 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:33 UTC | Fri, 03 Dec 2021 02:41:34 UTC |

	| stop    | -p                                       | NoKubernetes-20211203024124-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:34 UTC | Fri, 03 Dec 2021 02:41:35 UTC |

	|         | NoKubernetes-20211203024124-532170       |                                          |         |         |                               |                               |

	| start   | -p                                       | NoKubernetes-20211203024124-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:35 UTC | Fri, 03 Dec 2021 02:41:53 UTC |

	|         | NoKubernetes-20211203024124-532170       |                                          |         |         |                               |                               |

	|         | --driver=docker                          |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | NoKubernetes-20211203024124-532170       | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:53 UTC | Fri, 03 Dec 2021 02:41:59 UTC |

	|         | NoKubernetes-20211203024124-532170       |                                          |         |         |                               |                               |

	| delete  | -p                                       | kubenet-20211203024159-532170            | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:00 UTC | Fri, 03 Dec 2021 02:42:00 UTC |

	|         | kubenet-20211203024159-532170            |                                          |         |         |                               |                               |

	| delete  | -p                                       | flannel-20211203024200-532170            | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:01 UTC | Fri, 03 Dec 2021 02:42:01 UTC |

	|         | flannel-20211203024200-532170            |                                          |         |         |                               |                               |

	| delete  | -p false-20211203024201-532170           | false-20211203024201-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:02 UTC | Fri, 03 Dec 2021 02:42:02 UTC |

	| start   | -p pause-20211203024124-532170           | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:36 UTC |

	|         | --memory=2048                            |                                          |         |         |                               |                               |

	|         | --install-addons=false                   |                                          |         |         |                               |                               |

	|         | --wait=all --driver=docker               |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | offline-containerd-20211203024124-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:41:24 UTC | Fri, 03 Dec 2021 02:42:45 UTC |

	|         | offline-containerd-20211203024124-532170 |                                          |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --memory=2048     |                                          |         |         |                               |                               |

	|         | --wait=true --driver=docker              |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| delete  | -p                                       | offline-containerd-20211203024124-532170 | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:45 UTC | Fri, 03 Dec 2021 02:42:49 UTC |

	|         | offline-containerd-20211203024124-532170 |                                          |         |         |                               |                               |

	| start   | -p pause-20211203024124-532170           | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:36 UTC | Fri, 03 Dec 2021 02:42:52 UTC |

	|         | --alsologtostderr                        |                                          |         |         |                               |                               |

	|         | -v=1 --driver=docker                     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| -p      | pause-20211203024124-532170              | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:59 UTC | Fri, 03 Dec 2021 02:43:12 UTC |

	|         | logs -n 25                               |                                          |         |         |                               |                               |

	| -p      | pause-20211203024124-532170              | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:13 UTC | Fri, 03 Dec 2021 02:43:24 UTC |

	|         | logs -n 25                               |                                          |         |         |                               |                               |

	| -p      | pause-20211203024124-532170              | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:26 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | logs -n 25                               |                                          |         |         |                               |                               |

	| start   | -p                                       | force-systemd-env-20211203024249-532170  | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:49 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | force-systemd-env-20211203024249-532170  |                                          |         |         |                               |                               |

	|         | --memory=2048 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=5 --driver=docker                     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| -p      | force-systemd-env-20211203024249-532170  | force-systemd-env-20211203024249-532170  | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:38 UTC |

	|         | ssh cat /etc/containerd/config.toml      |                                          |         |         |                               |                               |

	| unpause | -p pause-20211203024124-532170           | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:39 UTC |

	|         | --alsologtostderr -v=5                   |                                          |         |         |                               |                               |

	| delete  | -p                                       | force-systemd-env-20211203024249-532170  | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:38 UTC | Fri, 03 Dec 2021 02:43:41 UTC |

	|         | force-systemd-env-20211203024249-532170  |                                          |         |         |                               |                               |

	| start   | -p                                       | running-upgrade-20211203024210-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:42:51 UTC | Fri, 03 Dec 2021 02:43:58 UTC |

	|         | running-upgrade-20211203024210-532170    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=docker                     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| start   | -p                                       | stopped-upgrade-20211203024124-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:05 UTC | Fri, 03 Dec 2021 02:43:58 UTC |

	|         | stopped-upgrade-20211203024124-532170    |                                          |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr          |                                          |         |         |                               |                               |

	|         | -v=1 --driver=docker                     |                                          |         |         |                               |                               |

	|         | --container-runtime=containerd           |                                          |         |         |                               |                               |

	| logs    | -p                                       | stopped-upgrade-20211203024124-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:58 UTC | Fri, 03 Dec 2021 02:43:59 UTC |

	|         | stopped-upgrade-20211203024124-532170    |                                          |         |         |                               |                               |

	| -p      | pause-20211203024124-532170              | pause-20211203024124-532170              | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:49 UTC | Fri, 03 Dec 2021 02:44:01 UTC |

	|         | logs -n 25                               |                                          |         |         |                               |                               |

	| delete  | -p                                       | running-upgrade-20211203024210-532170    | jenkins | v1.24.0 | Fri, 03 Dec 2021 02:43:58 UTC | Fri, 03 Dec 2021 02:44:01 UTC |

	|         | running-upgrade-20211203024210-532170    |                                          |         |         |                               |                               |

	|---------|------------------------------------------|------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:44:01

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:44:01.885615  681733 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:44:01.885734  681733 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:44:01.885745  681733 out.go:310] Setting ErrFile to fd 2...

	I1203 02:44:01.885751  681733 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:44:01.885894  681733 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:44:01.886238  681733 out.go:304] Setting JSON to false

	I1203 02:44:01.926487  681733 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":16003,"bootTime":1638483439,"procs":228,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:44:01.926616  681733 start.go:122] virtualization: kvm guest

	I1203 02:44:01.929295  681733 out.go:176] * [force-systemd-flag-20211203024401-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:44:01.931181  681733 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:44:01.929467  681733 notify.go:174] Checking for updates...

	I1203 02:44:01.932965  681733 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:44:01.934754  681733 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:44:01.936563  681733 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:44:01.937208  681733 config.go:176] Loaded profile config "missing-upgrade-20211203024341-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.18.0

	I1203 02:44:01.937353  681733 config.go:176] Loaded profile config "pause-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:44:01.937500  681733 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:44:01.937561  681733 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:44:02.008650  681733 docker.go:132] docker version: linux-19.03.15

	I1203 02:44:02.008758  681733 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:44:02.117952  681733 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:61 OomKillDisable:true NGoroutines:68 SystemTime:2021-12-03 02:44:02.059575383 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:44:02.118060  681733 docker.go:237] overlay module found

	I1203 02:44:02.122370  681733 out.go:176] * Using the docker driver based on user configuration

	I1203 02:44:02.122410  681733 start.go:280] selected driver: docker

	I1203 02:44:02.122418  681733 start.go:775] validating driver "docker" against <nil>

	I1203 02:44:02.122442  681733 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:44:02.122508  681733 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:44:02.122531  681733 out.go:241] ! Your cgroup does not allow setting memory.

	I1203 02:44:02.125026  681733 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:44:02.126114  681733 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:44:02.230547  681733 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:76 OomKillDisable:true NGoroutines:71 SystemTime:2021-12-03 02:44:02.172576015 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:44:02.230646  681733 start_flags.go:268] no existing cluster config was found, will generate one from the flags

	I1203 02:44:02.230805  681733 start_flags.go:740] Wait components to verify : map[apiserver:true system_pods:true]

	I1203 02:44:02.230825  681733 cni.go:93] Creating CNI manager for ""

	I1203 02:44:02.230830  681733 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:44:02.230841  681733 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:44:02.230851  681733 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:44:02.230857  681733 start_flags.go:277] Found "CNI" CNI - setting NetworkPlugin=cni

	I1203 02:44:02.230869  681733 start_flags.go:282] config:

	{Name:force-systemd-flag-20211203024401-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:force-systemd-flag-20211203024401-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:44:02.241931  681733 out.go:176] * Starting control plane node force-systemd-flag-20211203024401-532170 in cluster force-systemd-flag-20211203024401-532170

	I1203 02:44:02.242000  681733 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:44:02.244358  681733 out.go:176] * Pulling base image ...

	I1203 02:44:02.244411  681733 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:44:02.244499  681733 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4

	I1203 02:44:02.244505  681733 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1203 02:44:02.244526  681733 cache.go:57] Caching tarball of preloaded images

	I1203 02:44:02.244794  681733 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4 in cache, skipping download

	I1203 02:44:02.244827  681733 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.4 on containerd

	I1203 02:44:02.245013  681733 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-flag-20211203024401-532170/config.json ...

	I1203 02:44:02.245061  681733 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/force-systemd-flag-20211203024401-532170/config.json: {Name:mk9903f440571715d877b1ef030b9684dbf1ee9d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1203 02:44:02.366069  681733 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1203 02:44:02.366118  681733 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1203 02:44:02.366136  681733 cache.go:206] Successfully downloaded all kic artifacts

	I1203 02:44:02.366206  681733 start.go:313] acquiring machines lock for force-systemd-flag-20211203024401-532170: {Name:mkd8f60a0a910a2fc3d328420e6e318dab554442 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1203 02:44:02.366358  681733 start.go:317] acquired machines lock for "force-systemd-flag-20211203024401-532170" in 128.249µs

	I1203 02:44:02.366385  681733 start.go:89] Provisioning new machine with config: &{Name:force-systemd-flag-20211203024401-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:force-systemd-flag-20211203024401-532170 Namespace:default APIServerNam

e:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host} &{Name: IP: Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}

	I1203 02:44:02.366536  681733 start.go:126] createHost starting for "" (driver="docker")

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	44ad2903327a4       6e38f40d628db       About a minute ago   Running             storage-provisioner       0                   9d44abe734bc7

	fa412d0bc64fe       8d147537fb7d1       About a minute ago   Running             coredns                   0                   989b0a20cd6bf

	9fe05a46928d7       6de166512aa22       About a minute ago   Running             kindnet-cni               0                   52fd468fab925

	b96a30f689aa8       edeff87e48029       About a minute ago   Running             kube-proxy                0                   1150dc7540b90

	da77c4c16ea38       0ce02f92d3e43       2 minutes ago        Running             kube-controller-manager   0                   75715f0308eb1

	377954dfce779       721ba97f54a65       2 minutes ago        Running             kube-scheduler            0                   4b59fc65934a4

	c6bb5925aa26b       0048118155842       2 minutes ago        Running             etcd                      0                   26442a09720c6

	7861cc2da74e1       8a5cc299272d9       2 minutes ago        Running             kube-apiserver            0                   1a438759f3a6e

	* ==> containerd <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:44:03 UTC. --

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222703254Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222716851Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222726647Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222848435Z" level=warning msg="`default_runtime` is deprecated, please use `default_runtime_name` to reference the default configuration you have defined in `runtimes`"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.222920521Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:default DefaultRuntime:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} UntrustedWorkloadRuntime:{Type: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} Runtimes:map[default:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:<nil> PrivilegedWithoutHostDevices:false BaseRuntimeSpec:} runc:{Type:io.containerd.runc.v2 Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:0xc00041ffb0 PrivilegedWithoutHostDevices:false BaseRuntimeSpec:}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:true} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPlugin

ConfDir:/etc/cni/net.mk NetworkPluginMaxConfNum:1 NetworkPluginConfTemplate:} Registry:{Mirrors:map[docker.io:{Endpoints:[https://registry-1.docker.io]}] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:} DisableTCPService:true StreamServerAddress: StreamServerPort:10010 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:k8s.gcr.io/pause:3.5 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true IgnoreImageDefinedVolumes:false} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223014188Z" level=info msg="Connect containerd service"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223064254Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223824728Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.223940610Z" level=info msg="Start subscribing containerd event"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224031243Z" level=info msg="Start recovering state"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224569581Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224644393Z" level=info msg=serving... address=/run/containerd/containerd.sock

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.224702180Z" level=info msg="containerd successfully booted in 0.040989s"

	Dec 03 02:42:38 pause-20211203024124-532170 systemd[1]: Started containerd container runtime.

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310686273Z" level=info msg="Start event monitor"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310736093Z" level=info msg="Start snapshots syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310744594Z" level=info msg="Start cni network conf syncer"

	Dec 03 02:42:38 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:38.310757514Z" level=info msg="Start streaming server"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.156621095Z" level=info msg="RunPodsandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.186943591Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f pid=2529

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.361766697Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:9aa5302f-010c-4351-96c2-b2485180be47,Namespace:kube-system,Attempt:0,} returns sandbox id \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.365150740Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.436686048Z" level=info msg="CreateContainer within sandbox \"9d44abe734bc79e2d4d48b83d30dedf4138f459cc1229518929db77d5d799c0f\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.437875321Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\""

	Dec 03 02:42:51 pause-20211203024124-532170 containerd[2242]: time="2021-12-03T02:42:51.586425386Z" level=info msg="StartContainer for \"44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8\" returns successfully"

	* ==> coredns [fa412d0bc64fe41cabe75d75b154341ad2989d0d273aca5f583e5b450247fcaf] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	W1203 02:43:19.553172       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553228       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Namespace ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	W1203 02:43:19.553214       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding

	I1203 02:43:30.407345       1 trace.go:205] Trace[336122540]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.405) (total time: 10001ms):

	Trace[336122540]: [10.001491184s] [10.001491184s] END

	E1203 02:43:30.407394       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=505": net/http: TLS handshake timeout

	I1203 02:43:30.693805       1 trace.go:205] Trace[646203300]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.693) (total time: 10000ms):

	Trace[646203300]: [10.000566421s] [10.000566421s] END

	E1203 02:43:30.693839       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=286": net/http: TLS handshake timeout

	I1203 02:43:30.903614       1 trace.go:205] Trace[1747278511]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167 (03-Dec-2021 02:43:20.902) (total time: 10000ms):

	Trace[1747278511]: [10.000749713s] [10.000749713s] END

	E1203 02:43:30.903650       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=210": net/http: TLS handshake timeout

	* ==> describe nodes <==

	* ==> dmesg <==

	* [Dec 3 02:35] cgroup: cgroup2: unknown option "nsdelegate"

	[ +43.145422] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.997001] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethae8775a3

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 09 60 d3 6c 6f 08 06        ........`.lo..

	[Dec 3 02:36] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:38] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethc07b7bb4

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff 9a 08 d6 d0 27 5c 08 06        ..........'\..

	[Dec 3 02:39] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:40] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth5d5f7a44

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 9e b4 3b e2 7b 9d 08 06        ........;.{...

	[Dec 3 02:41] cgroup: cgroup2: unknown option "nsdelegate"

	[ +14.204723] cgroup: cgroup2: unknown option "nsdelegate"

	[  +1.025718] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.991957] cgroup: cgroup2: unknown option "nsdelegate"

	[ +19.678388] cgroup: cgroup2: unknown option "nsdelegate"

	[  +2.060023] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:42] cgroup: cgroup2: unknown option "nsdelegate"

	[ +13.603429] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev veth170a53a8

	[  +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 4a 38 90 3b cc 08 06        .......J8.;...

	[  +9.575101] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethe30be4e2

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa eb 14 cd 69 e4 08 06        ..........i...

	[  +9.369686] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:43] cgroup: cgroup2: unknown option "nsdelegate"

	[ +44.054897] cgroup: cgroup2: unknown option "nsdelegate"

	[Dec 3 02:44] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [c6bb5925aa26bb7f20b1c83f7c74ac39e07a5a726abc7531bf949e0549809c83] <==

	* {"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[615955715] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"1.188717958s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[615955715] 'read index received'  (duration: 968.013476ms)","trace[615955715] 'applied index is now lower than readState.Index'  (duration: 220.703541ms)"],"step_count":2}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1851729177] transaction","detail":"{read_only:false; response_revision:530; number_of_response:1; }","duration":"1.582656878s","start":"2021-12-03T02:42:53.270Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1851729177] 'compare'  (duration: 1.582261694s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.613711605s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.188840443s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1129"}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[43474745] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:530; }","duration":"1.188875717s","start":"2021-12-03T02:42:53.664Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[43474745] 'agreement among raft nodes before linearized reading'  (duration: 1.188815061s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:54.852Z","caller":"traceutil/trace.go:171","msg":"trace[1805756956] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:529; }","duration":"1.613993557s","start":"2021-12-03T02:42:53.238Z","end":"2021-12-03T02:42:54.852Z","steps":["trace[1805756956] 'range keys from in-memory index tree'  (duration: 1.61359796s)"],"step_count":1}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.664Z","time spent":"1.188915825s","remote":"127.0.0.1:33864","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1153,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.852Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.238Z","time spent":"1.614050289s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:54.853Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:53.270Z","time spent":"1.582731298s","remote":"127.0.0.1:33918","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":598,"response count":0,"response size":40,"request content":"compare:<target:MOD key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" mod_revision:510 > success:<request_put:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" value_size:530 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/pause-20211203024124-532170\" > >"}

	{"level":"warn","ts":"2021-12-03T02:42:55.362Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:55.862Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.363Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100279,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-12-03T02:42:56.800Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"1.939127407s","expected-duration":"1s"}

	{"level":"info","ts":"2021-12-03T02:42:56.800Z","caller":"traceutil/trace.go:171","msg":"trace[121078242] linearizableReadLoop","detail":"{readStateIndex:549; appliedIndex:549; }","duration":"1.939141286s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.800Z","steps":["trace[121078242] 'read index received'  (duration: 1.939133379s)","trace[121078242] 'applied index is now lower than readState.Index'  (duration: 6.677µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.953947612s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/kubernetes\" ","response":"range_response_count:1 size:706"}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.95289822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[634251822] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:531; }","duration":"1.953003147s","start":"2021-12-03T02:42:54.862Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[634251822] 'agreement among raft nodes before linearized reading'  (duration: 1.938259419s)"],"step_count":1}

	{"level":"info","ts":"2021-12-03T02:42:56.815Z","caller":"traceutil/trace.go:171","msg":"trace[1182520940] range","detail":"{range_begin:/registry/services/specs/default/kubernetes; range_end:; response_count:1; response_revision:531; }","duration":"1.954019471s","start":"2021-12-03T02:42:54.861Z","end":"2021-12-03T02:42:56.815Z","steps":["trace[1182520940] 'agreement among raft nodes before linearized reading'  (duration: 1.93925253s)","trace[1182520940] 'range keys from in-memory index tree'  (duration: 14.649038ms)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.862Z","time spent":"1.953050451s","remote":"127.0.0.1:33934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2021-12-03T02:42:56.815Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:42:54.861Z","time spent":"1.954077543s","remote":"127.0.0.1:33880","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":1,"response size":730,"request content":"key:\"/registry/services/specs/default/kubernetes\" "}

	{"level":"warn","ts":"2021-12-03T02:43:46.685Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":8128009408346100374,"retry-timeout":"500ms"}

	{"level":"info","ts":"2021-12-03T02:43:46.909Z","caller":"traceutil/trace.go:171","msg":"trace[1485506552] linearizableReadLoop","detail":"{readStateIndex:584; appliedIndex:584; }","duration":"724.853451ms","start":"2021-12-03T02:43:46.184Z","end":"2021-12-03T02:43:46.909Z","steps":["trace[1485506552] 'read index received'  (duration: 724.832693ms)","trace[1485506552] 'applied index is now lower than readState.Index'  (duration: 19.03µs)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:43:48.022Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.837689726s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true ","response":"range_response_count:0 size:7"}

	{"level":"info","ts":"2021-12-03T02:43:48.022Z","caller":"traceutil/trace.go:171","msg":"trace[27281358] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:0; response_revision:563; }","duration":"1.837795746s","start":"2021-12-03T02:43:46.184Z","end":"2021-12-03T02:43:48.022Z","steps":["trace[27281358] 'agreement among raft nodes before linearized reading'  (duration: 724.968239ms)","trace[27281358] 'count revisions from in-memory index tree'  (duration: 1.112693635s)"],"step_count":2}

	{"level":"warn","ts":"2021-12-03T02:43:48.022Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-12-03T02:43:46.184Z","time spent":"1.837855604s","remote":"127.0.0.1:33908","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":1,"response size":31,"request content":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true "}

	* ==> kernel <==

	*  02:44:13 up  4:26,  0 users,  load average: 6.82, 4.39, 2.40

	Linux pause-20211203024124-532170 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [7861cc2da74e14be1efce89a227b8a087e1a4ad74eea5a57fd9979faa37223b4] <==

	* k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1(0x7f4e242dede8, 0xc000acd840, 0xc00b36cb00)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:80 +0x75c

	net/http.HandlerFunc.ServeHTTP(0xc007fbfa40, 0x7f4e242dede8, 0xc000acd840, 0xc00b36c900)

		/usr/local/go/src/net/http/server.go:2049 +0x44

	k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1(0x7f4e242dede8, 0xc000acd840, 0xc00b36c800)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/endpoints/filterlatency/filterlatency.go:88 +0x38c

	net/http.HandlerFunc.ServeHTTP(0xc007fc0840, 0x7f4e242dede8, 0xc000acd840, 0xc00b36c800)

		/usr/local/go/src/net/http/server.go:2049 +0x44

	k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc00d15efc0, 0xc0049b58f0, 0x56b5388, 0xc000acd840, 0xc00b36c800)

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:108 +0xb8

	created by k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP

		/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:94 +0x1fa

	I1203 02:43:39.273452       1 trace.go:205] Trace[718628182]: "Get" url:/api/v1/namespaces/default/services/kubernetes,user-agent:kube-apiserver/v1.22.4 (linux/amd64) kubernetes/b695d79,audit-id:54fa5833-84a5-4ef6-ba03-68c014be0808,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (03-Dec-2021 02:42:54.861) (total time: 44412ms):

	Trace[718628182]: ---"About to write a response" 44412ms (02:43:39.273)

	Trace[718628182]: [44.412077247s] [44.412077247s] END

	E1203 02:43:39.273682       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E1203 02:43:39.273737       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E1203 02:43:39.273751       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1203 02:43:39.274119       1 authentication.go:63] "Unable to authenticate the request" err="[invalid bearer token, context canceled]"

	E1203 02:43:39.274156       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E1203 02:43:39.274763       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1203 02:43:39.275803       1 timeout.go:135] post-timeout activity - time-elapsed: 2.689165ms, GET "/api" result: <nil>

	E1203 02:43:39.284652       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E1203 02:43:39.288684       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E1203 02:43:39.292681       1 timeout.go:135] post-timeout activity - time-elapsed: 19.434706ms, GET "/api" result: <nil>

	* ==> kube-controller-manager [da77c4c16ea386dda39fcf91ff000cf63eb9f9b8cef0af731ccbbe2fe9f197dd] <==

	* I1203 02:42:19.698168       1 shared_informer.go:247] Caches are synced for PV protection

	I1203 02:42:19.698204       1 shared_informer.go:247] Caches are synced for expand

	I1203 02:42:19.723295       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-5xmj2"

	I1203 02:42:19.723336       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-n6hkm"

	I1203 02:42:19.723690       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1203 02:42:19.800345       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:19.829969       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-qwmpd"

	I1203 02:42:20.016290       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1203 02:42:20.026075       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-4z8xc"

	I1203 02:42:20.097398       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177064       1 shared_informer.go:247] Caches are synced for garbage collector

	I1203 02:42:20.177104       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1203 02:42:34.546360       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	E1203 02:43:35.121711       1 resource_quota_controller.go:413] failed to discover resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	W1203 02:43:35.121726       1 garbagecollector.go:705] failed to discover preferred resources: Get "https://192.168.49.2:8443/api?timeout=32s": http2: client connection lost

	I1203 02:43:39.904957       1 event.go:291] "Event occurred" object="pause-20211203024124-532170" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node pause-20211203024124-532170 status is now: NodeNotReady"

	I1203 02:43:39.910589       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978-qwmpd" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.916423       1 event.go:291] "Event occurred" object="kube-system/storage-provisioner" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.922264       1 event.go:291] "Event occurred" object="kube-system/etcd-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.926938       1 event.go:291] "Event occurred" object="kube-system/kube-apiserver-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.931619       1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.935422       1 event.go:291] "Event occurred" object="kube-system/kube-scheduler-pause-20211203024124-532170" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:39.996769       1 event.go:291] "Event occurred" object="kube-system/kindnet-n6hkm" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I1203 02:43:40.004161       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I1203 02:43:40.004423       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-5xmj2" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	* ==> kube-proxy [b96a30f689aa838a728994e19ad57f3194b434b5136e1ecab8a96d391bc05eaf] <==

	* I1203 02:42:20.634200       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1203 02:42:20.634302       1 server_others.go:140] Detected node IP 192.168.49.2

	W1203 02:42:20.634321       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1203 02:42:21.018258       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1203 02:42:21.018308       1 server_others.go:212] Using iptables Proxier.

	I1203 02:42:21.018322       1 server_others.go:219] creating dualStackProxier for iptables.

	W1203 02:42:21.018342       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1203 02:42:21.018662       1 server.go:649] Version: v1.22.4

	I1203 02:42:21.020100       1 config.go:224] Starting endpoint slice config controller

	I1203 02:42:21.020120       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1203 02:42:21.020193       1 config.go:315] Starting service config controller

	I1203 02:42:21.020198       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1203 02:42:21.121119       1 shared_informer.go:247] Caches are synced for service config

	I1203 02:42:21.121195       1 shared_informer.go:247] Caches are synced for endpoint slice config

	* ==> kube-scheduler [377954dfce779fd5854219f915357e582012617cb03c0a70c60b9987499185ac] <==

	* W1203 02:42:03.294201       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1203 02:42:03.406171       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1203 02:42:03.406300       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1203 02:42:03.406324       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1203 02:42:03.406344       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1203 02:42:03.407679       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1203 02:42:03.415896       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1203 02:42:03.416427       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.418623       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1203 02:42:03.421833       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1203 02:42:03.422567       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1203 02:42:03.422726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.422862       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1203 02:42:03.423000       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:03.423347       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423470       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:03.423544       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1203 02:42:03.423558       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:03.423644       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1203 02:42:03.424827       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1203 02:42:04.333813       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1203 02:42:04.364124       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1203 02:42:04.365071       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1203 02:42:04.472526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I1203 02:42:04.906826       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-12-03 02:41:27 UTC, end at Fri 2021-12-03 02:44:13 UTC. --

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --network-plugin has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --runtime-request-timeout has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --cni-conf-dir has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --network-plugin has been deprecated, will be removed along with dockershim.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: Flag --runtime-request-timeout has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.665053    3719 server.go:440] "Kubelet version" kubeletVersion="v1.22.4"

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.665515    3719 server.go:868] "Client rotation is on, will bootstrap in background"

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.694363    3719 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".

	Dec 03 02:43:39 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:39.695767    3719 dynamic_cafile_content.go:155] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 03 02:43:40 pause-20211203024124-532170 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Dec 03 02:43:40 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:40.141519    3719 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706117    3719 server.go:687] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706429    3719 container_manager_linux.go:280] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706502    3719 container_manager_linux.go:285] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerPolicyOptions:map[] ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706553    3719 topology_manager.go:133] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706568    3719 container_manager_linux.go:320] "Creating device plugin manager" devicePluginEnabled=true

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706608    3719 state_mem.go:36] "Initialized new in-memory state store"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706949    3719 kubelet.go:418] "Attempting to sync node with API server"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.706982    3719 kubelet.go:279] "Adding static pod path" path="/etc/kubernetes/manifests"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.707012    3719 kubelet.go:290] "Adding apiserver pod source"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.707042    3719 apiserver.go:42] "Waiting for node sync before watching apiserver pods"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.711318    3719 kuberuntime_manager.go:245] "Container runtime initialized" containerRuntime="containerd" version="1.4.9" apiVersion="v1alpha2"

	Dec 03 02:43:44 pause-20211203024124-532170 kubelet[3719]: I1203 02:43:44.712766    3719 server.go:1213] "Started kubelet"

	Dec 03 02:43:44 pause-20211203024124-532170 systemd[1]: kubelet.service: Succeeded.

	Dec 03 02:43:44 pause-20211203024124-532170 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [44ad2903327a4831a287d02d9bf015c7c79184800d7de792ec88dd259c43c6f8] <==

	* I1203 02:42:51.601493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1203 02:42:51.615295       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1203 02:42:51.615709       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1203 02:42:51.641608       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1203 02:42:51.641868       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

	I1203 02:42:51.643094       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbc908e7-bac3-41f4-ad8a-28a0acbab933", APIVersion:"v1", ResourceVersion:"527", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d became leader

	I1203 02:42:51.742125       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20211203024124-532170_e895639e-54d7-41f8-ba55-6be5b703777d!

-- /stdout --

** stderr **

	E1203 02:44:13.629750  682254 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170

helpers_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p pause-20211203024124-532170 -n pause-20211203024124-532170: exit status 2 (388.77858ms)

-- stdout --

	Paused

-- /stdout --

helpers_test.go:255: status error: exit status 2 (may be ok)

helpers_test.go:257: "pause-20211203024124-532170" apiserver is not running, skipping kubectl commands (state="Paused")

--- FAIL: TestPause/serial/PauseAgain (34.67s)

Test pass (256/283)

Order	passed test	Duration
3	TestDownloadOnly/v1.16.0/json-events	12.83
4	TestDownloadOnly/v1.16.0/preload-exists	0
8	TestDownloadOnly/v1.16.0/LogsDuration	0.07
10	TestDownloadOnly/v1.22.4/json-events	6.97
11	TestDownloadOnly/v1.22.4/preload-exists	0
15	TestDownloadOnly/v1.22.4/LogsDuration	0.07
17	TestDownloadOnly/v1.23.0-beta.0/json-events	25.96
18	TestDownloadOnly/v1.23.0-beta.0/preload-exists	0
22	TestDownloadOnly/v1.23.0-beta.0/LogsDuration	0.07
23	TestDownloadOnly/DeleteAll	0.4
24	TestDownloadOnly/DeleteAlwaysSucceeds	0.24
25	TestDownloadOnlyKic	18.83
26	TestOffline	84.9
28	TestAddons/Setup	134.81
30	TestAddons/parallel/Registry	25.14
31	TestAddons/parallel/Ingress	47.04
32	TestAddons/parallel/MetricsServer	5.69
33	TestAddons/parallel/HelmTiller	17.97
34	TestAddons/parallel/Olm	45.62
35	TestAddons/parallel/CSI	52.16
37	TestAddons/serial/GCPAuth	46.14
38	TestAddons/StoppedEnableDisable	20.87
39	TestCertOptions	49.25
40	TestCertExpiration	278.63
42	TestForceSystemdFlag	246.25
43	TestForceSystemdEnv	52.65
44	TestKVMDriverInstallOrUpdate	7.75
48	TestErrorSpam/setup	41.43
49	TestErrorSpam/start	0.97
50	TestErrorSpam/status	1.19
51	TestErrorSpam/pause	1.54
52	TestErrorSpam/unpause	1.5
53	TestErrorSpam/stop	23.62
56	TestFunctional/serial/CopySyncFile	0
57	TestFunctional/serial/StartWithProxy	65.44
58	TestFunctional/serial/AuditLog	0
59	TestFunctional/serial/SoftStart	15.58
60	TestFunctional/serial/KubeContext	0.04
61	TestFunctional/serial/KubectlGetPods	0.17
64	TestFunctional/serial/CacheCmd/cache/add_remote	3.55
65	TestFunctional/serial/CacheCmd/cache/add_local	2.34
66	TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3	0.06
67	TestFunctional/serial/CacheCmd/cache/list	0.06
68	TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node	0.37
69	TestFunctional/serial/CacheCmd/cache/cache_reload	2.02
70	TestFunctional/serial/CacheCmd/cache/delete	0.12
71	TestFunctional/serial/MinikubeKubectlCmd	0.11
72	TestFunctional/serial/MinikubeKubectlCmdDirectly	0.1
73	TestFunctional/serial/ExtraConfig	45.09
74	TestFunctional/serial/ComponentHealth	0.07
75	TestFunctional/serial/LogsCmd	1.12
76	TestFunctional/serial/LogsFileCmd	1.11
78	TestFunctional/parallel/ConfigCmd	0.43
79	TestFunctional/parallel/DashboardCmd	4.24
80	TestFunctional/parallel/DryRun	0.65
81	TestFunctional/parallel/InternationalLanguage	0.29
82	TestFunctional/parallel/StatusCmd	1.6
85	TestFunctional/parallel/ServiceCmd	16.08
86	TestFunctional/parallel/AddonsCmd	0.17
87	TestFunctional/parallel/PersistentVolumeClaim	29.37
89	TestFunctional/parallel/SSHCmd	0.86
90	TestFunctional/parallel/CpCmd	1.45
91	TestFunctional/parallel/MySQL	22.58
92	TestFunctional/parallel/FileSync	0.59
93	TestFunctional/parallel/CertSync	2.4
97	TestFunctional/parallel/NodeLabels	0.07
99	TestFunctional/parallel/NonActiveRuntimeDisabled	0.88
101	TestFunctional/parallel/ProfileCmd/profile_not_create	0.59
103	TestFunctional/parallel/TunnelCmd/serial/StartTunnel	0
105	TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup	9.27
106	TestFunctional/parallel/ProfileCmd/profile_list	0.54
107	TestFunctional/parallel/ProfileCmd/profile_json_output	0.45
108	TestFunctional/parallel/UpdateContextCmd/no_changes	0.21
109	TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster	0.2
110	TestFunctional/parallel/UpdateContextCmd/no_clusters	0.21
111	TestFunctional/parallel/ImageCommands/ImageList	0.25
112	TestFunctional/parallel/ImageCommands/ImageBuild	4.18
113	TestFunctional/parallel/ImageCommands/Setup	1.02
114	TestFunctional/parallel/ImageCommands/ImageLoadDaemon	5.09
115	TestFunctional/parallel/ImageCommands/ImageReloadDaemon	4.95
116	TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP	0.06
117	TestFunctional/parallel/TunnelCmd/serial/AccessDirect	0
121	TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel	0.11
122	TestFunctional/parallel/Version/short	0.06
123	TestFunctional/parallel/Version/components	0.57
124	TestFunctional/parallel/MountCmd/any-port	8.16
125	TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon	4.57
126	TestFunctional/parallel/ImageCommands/ImageSaveToFile	1.09
127	TestFunctional/parallel/ImageCommands/ImageRemove	0.6
128	TestFunctional/parallel/MountCmd/specific-port	2.33
129	TestFunctional/parallel/ImageCommands/ImageLoadFromFile	1.41
130	TestFunctional/parallel/ImageCommands/ImageSaveDaemon	2.14
131	TestFunctional/delete_addon-resizer_images	0.09
132	TestFunctional/delete_my-image_image	0.04
133	TestFunctional/delete_minikube_cached_images	0.04
136	TestIngressAddonLegacy/StartLegacyK8sCluster	89.83
138	TestIngressAddonLegacy/serial/ValidateIngressAddonActivation	13.69
139	TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation	0.38
140	TestIngressAddonLegacy/serial/ValidateIngressAddons	49.92
143	TestJSONOutput/start/Command	55.32
144	TestJSONOutput/start/Audit	0
146	TestJSONOutput/start/parallel/DistinctCurrentSteps	0
147	TestJSONOutput/start/parallel/IncreasingCurrentSteps	0
149	TestJSONOutput/pause/Command	0.66
150	TestJSONOutput/pause/Audit	0
152	TestJSONOutput/pause/parallel/DistinctCurrentSteps	0
153	TestJSONOutput/pause/parallel/IncreasingCurrentSteps	0
155	TestJSONOutput/unpause/Command	0.64
156	TestJSONOutput/unpause/Audit	0
158	TestJSONOutput/unpause/parallel/DistinctCurrentSteps	0
159	TestJSONOutput/unpause/parallel/IncreasingCurrentSteps	0
161	TestJSONOutput/stop/Command	24.41
162	TestJSONOutput/stop/Audit	0
164	TestJSONOutput/stop/parallel/DistinctCurrentSteps	0
165	TestJSONOutput/stop/parallel/IncreasingCurrentSteps	0
166	TestErrorJSONOutput	0.34
168	TestKicCustomNetwork/create_custom_network	27.5
169	TestKicCustomNetwork/use_default_bridge_network	24.95
170	TestKicExistingNetwork	24.59
171	TestMainNoArgs	0.06
174	TestMountStart/serial/StartWithMountFirst	24.8
175	TestMountStart/serial/StartWithMountSecond	40.46
176	TestMountStart/serial/VerifyMountFirst	0.34
177	TestMountStart/serial/VerifyMountSecond	0.34
178	TestMountStart/serial/DeleteFirst	2.97
179	TestMountStart/serial/VerifyMountPostDelete	0.35
180	TestMountStart/serial/Stop	20.48
181	TestMountStart/serial/RestartStopped	33.56
182	TestMountStart/serial/VerifyMountPostStop	0.35
185	TestMultiNode/serial/FreshStart2Nodes	107.34
186	TestMultiNode/serial/DeployApp2Nodes	5.57
187	TestMultiNode/serial/PingHostFrom2Pods	0.87
188	TestMultiNode/serial/AddNode	41.49
189	TestMultiNode/serial/ProfileList	0.37
190	TestMultiNode/serial/CopyFile	12.35
191	TestMultiNode/serial/StopNode	22.03
192	TestMultiNode/serial/StartAfterStop	35.5
193	TestMultiNode/serial/RestartKeepsNodes	190.96
194	TestMultiNode/serial/DeleteNode	25.22
195	TestMultiNode/serial/StopMultiNode	41.6
196	TestMultiNode/serial/RestartMultiNode	91.93
197	TestMultiNode/serial/ValidateNameConflict	44
202	TestPreload	145.89
204	TestScheduledStopUnix	118.81
207	TestInsufficientStorage	13.38
208	TestRunningBinaryUpgrade	111.23
210	TestKubernetesUpgrade	249.41
211	TestMissingContainerUpgrade	137.44
215	TestNoKubernetes/serial/StartNoK8sWithVersion	0.13
217	TestStoppedBinaryUpgrade/Setup	1.38
223	TestPause/serial/Start	71.88
224	TestNoKubernetes/serial/Start	8.34
225	TestStoppedBinaryUpgrade/Upgrade	153.14
226	TestNoKubernetes/serial/VerifyK8sNotRunning	0.37
227	TestNoKubernetes/serial/ProfileList	1.45
228	TestNoKubernetes/serial/Stop	1.41
229	TestNoKubernetes/serial/StartNoArgs	17.09
230	TestNoKubernetes/serial/VerifyK8sNotRunningSecond	0.49
238	TestNetworkPlugins/group/false	1.04
242	TestPause/serial/SecondStartNoReconfiguration	16.04
245	TestPause/serial/Unpause	0.86
247	TestStoppedBinaryUpgrade/MinikubeLogs	1.07
248	TestPause/serial/DeletePaused	10.92
249	TestPause/serial/VerifyDeletedResources	0.75
251	TestStartStop/group/old-k8s-version/serial/FirstStart	122.25
253	TestStartStop/group/embed-certs/serial/FirstStart	79.65
255	TestStartStop/group/no-preload/serial/FirstStart	88.2
256	TestStartStop/group/old-k8s-version/serial/DeployApp	9.59
257	TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive	0.64
258	TestStartStop/group/old-k8s-version/serial/Stop	21.14
260	TestStartStop/group/default-k8s-different-port/serial/FirstStart	70.8
261	TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop	0.21
262	TestStartStop/group/old-k8s-version/serial/SecondStart	438.08
263	TestStartStop/group/embed-certs/serial/DeployApp	10.48
264	TestStartStop/group/embed-certs/serial/EnableAddonWhileActive	1.36
265	TestStartStop/group/embed-certs/serial/Stop	20.9
266	TestStartStop/group/no-preload/serial/DeployApp	13.49
267	TestStartStop/group/no-preload/serial/EnableAddonWhileActive	0.68
268	TestStartStop/group/no-preload/serial/Stop	21.07
269	TestStartStop/group/embed-certs/serial/EnableAddonAfterStop	0.23
270	TestStartStop/group/embed-certs/serial/SecondStart	328.32
271	TestStartStop/group/default-k8s-different-port/serial/DeployApp	10.47
272	TestStartStop/group/no-preload/serial/EnableAddonAfterStop	0.21
273	TestStartStop/group/no-preload/serial/SecondStart	337.2
274	TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive	0.74
275	TestStartStop/group/default-k8s-different-port/serial/Stop	20.73
276	TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop	0.21
277	TestStartStop/group/default-k8s-different-port/serial/SecondStart	328.84
278	TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop	5.02
279	TestStartStop/group/embed-certs/serial/AddonExistsAfterStop	5.09
280	TestStartStop/group/embed-certs/serial/VerifyKubernetesImages	0.39
281	TestStartStop/group/embed-certs/serial/Pause	3.14
283	TestStartStop/group/newest-cni/serial/FirstStart	95.78
284	TestStartStop/group/no-preload/serial/UserAppExistsAfterStop	5.02
285	TestStartStop/group/no-preload/serial/AddonExistsAfterStop	5.15
286	TestStartStop/group/no-preload/serial/VerifyKubernetesImages	0.39
287	TestStartStop/group/no-preload/serial/Pause	3.97
288	TestNetworkPlugins/group/auto/Start	81.97
289	TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop	5.02
290	TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop	5.1
291	TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages	0.4
292	TestStartStop/group/default-k8s-different-port/serial/Pause	12.99
293	TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop	5.02
294	TestNetworkPlugins/group/cilium/Start	92.79
295	TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop	5.09
296	TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages	0.4
297	TestStartStop/group/old-k8s-version/serial/Pause	3.37
298	TestNetworkPlugins/group/calico/Start	82.77
299	TestStartStop/group/newest-cni/serial/DeployApp	0
300	TestStartStop/group/newest-cni/serial/EnableAddonWhileActive	0.74
301	TestStartStop/group/newest-cni/serial/Stop	20.9
302	TestNetworkPlugins/group/auto/KubeletFlags	0.37
303	TestNetworkPlugins/group/auto/NetCatPod	9.25
304	TestStartStop/group/newest-cni/serial/EnableAddonAfterStop	0.26
305	TestStartStop/group/newest-cni/serial/SecondStart	76.69
306	TestNetworkPlugins/group/auto/DNS	0.27
307	TestNetworkPlugins/group/auto/Localhost	0.17
308	TestNetworkPlugins/group/auto/HairPin	0.19
309	TestNetworkPlugins/group/custom-weave/Start	83.12
310	TestNetworkPlugins/group/cilium/ControllerPod	5.02
311	TestNetworkPlugins/group/calico/ControllerPod	5.02
312	TestNetworkPlugins/group/cilium/KubeletFlags	0.64
313	TestNetworkPlugins/group/cilium/NetCatPod	12.21
314	TestNetworkPlugins/group/calico/KubeletFlags	0.48
315	TestNetworkPlugins/group/calico/NetCatPod	9.4
316	TestNetworkPlugins/group/cilium/DNS	0.17
317	TestNetworkPlugins/group/cilium/Localhost	0.16
318	TestNetworkPlugins/group/cilium/HairPin	0.15
319	TestNetworkPlugins/group/calico/DNS	0.17
320	TestNetworkPlugins/group/calico/Localhost	0.21
321	TestNetworkPlugins/group/calico/HairPin	0.18
322	TestNetworkPlugins/group/kindnet/Start	74.61
323	TestNetworkPlugins/group/enable-default-cni/Start	69.01
324	TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop	0
325	TestStartStop/group/newest-cni/serial/AddonExistsAfterStop	0
326	TestStartStop/group/newest-cni/serial/VerifyKubernetesImages	0.38
327	TestStartStop/group/newest-cni/serial/Pause	3
328	TestNetworkPlugins/group/bridge/Start	59.41
329	TestNetworkPlugins/group/custom-weave/KubeletFlags	0.4
330	TestNetworkPlugins/group/custom-weave/NetCatPod	10.22
331	TestNetworkPlugins/group/enable-default-cni/KubeletFlags	0.41
332	TestNetworkPlugins/group/enable-default-cni/NetCatPod	9.37
333	TestNetworkPlugins/group/kindnet/ControllerPod	5.02
334	TestNetworkPlugins/group/enable-default-cni/DNS	0.2
335	TestNetworkPlugins/group/enable-default-cni/Localhost	0.17
336	TestNetworkPlugins/group/kindnet/KubeletFlags	0.47
337	TestNetworkPlugins/group/enable-default-cni/HairPin	0.18
338	TestNetworkPlugins/group/kindnet/NetCatPod	9.35
339	TestNetworkPlugins/group/bridge/KubeletFlags	0.37
340	TestNetworkPlugins/group/bridge/NetCatPod	10.33
341	TestNetworkPlugins/group/kindnet/DNS	0.16
342	TestNetworkPlugins/group/kindnet/Localhost	0.17
343	TestNetworkPlugins/group/kindnet/HairPin	0.14
344	TestNetworkPlugins/group/bridge/DNS	0.16
345	TestNetworkPlugins/group/bridge/Localhost	0.14
346	TestNetworkPlugins/group/bridge/HairPin	0.15

–

TestDownloadOnly/v1.16.0/json-events (12.83s)

=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (12.830538062s)

--- PASS: TestDownloadOnly/v1.16.0/json-events (12.83s)

–

TestDownloadOnly/v1.16.0/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.16.0/preload-exists

--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

–

TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.16.0/LogsDuration

aaa_download_only_test.go:171: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20211203020847-532170

aaa_download_only_test.go:171: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20211203020847-532170: exit status 85 (67.929257ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:08:47

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:08:47.326198  532182 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:08:47.326281  532182 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:08:47.326286  532182 out.go:310] Setting ErrFile to fd 2...

	I1203 02:08:47.326292  532182 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:08:47.326432  532182 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	W1203 02:08:47.326565  532182 root.go:293] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: no such file or directory

	I1203 02:08:47.326838  532182 out.go:304] Setting JSON to true

	I1203 02:08:47.363729  532182 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":13888,"bootTime":1638483439,"procs":164,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:08:47.363840  532182 start.go:122] virtualization: kvm guest

	W1203 02:08:47.366712  532182 preload.go:294] Failed to list preload files: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball: no such file or directory

	I1203 02:08:47.366778  532182 notify.go:174] Checking for updates...

	I1203 02:08:47.368497  532182 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:08:47.414720  532182 docker.go:132] docker version: linux-19.03.15

	I1203 02:08:47.414831  532182 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:08:47.498671  532182 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:08:47.451599917 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:08:47.498761  532182 docker.go:237] overlay module found

	I1203 02:08:47.500645  532182 start.go:280] selected driver: docker

	I1203 02:08:47.500667  532182 start.go:775] validating driver "docker" against <nil>

	I1203 02:08:47.501124  532182 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:08:47.582983  532182 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:08:47.536355484 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:08:47.583111  532182 start_flags.go:268] no existing cluster config was found, will generate one from the flags

	I1203 02:08:47.583616  532182 start_flags.go:349] Using suggested 8000MB memory alloc based on sys=32179MB, container=32179MB

	I1203 02:08:47.583717  532182 start_flags.go:740] Wait components to verify : map[apiserver:true system_pods:true]

	I1203 02:08:47.583743  532182 cni.go:93] Creating CNI manager for ""

	I1203 02:08:47.583751  532182 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:08:47.583766  532182 cni.go:217] auto-setting extra-config to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:08:47.583772  532182 cni.go:222] extra-config set to "kubelet.cni-conf-dir=/etc/cni/net.mk"

	I1203 02:08:47.583778  532182 start_flags.go:277] Found "CNI" CNI - setting NetworkPlugin=cni

	I1203 02:08:47.583809  532182 start_flags.go:282] config:

	{Name:download-only-20211203020847-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-20211203020847-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:cont

ainerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:08:47.585783  532182 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:08:47.587298  532182 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd

	I1203 02:08:47.587385  532182 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1203 02:08:47.682934  532182 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1203 02:08:47.682963  532182 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1203 02:08:47.704373  532182 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.16.0-containerd-overlay2-amd64.tar.lz4

	I1203 02:08:47.704406  532182 cache.go:57] Caching tarball of preloaded images

	I1203 02:08:47.704731  532182 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd

	I1203 02:08:47.706842  532182 preload.go:238] getting checksum for preloaded-images-k8s-v14-v1.16.0-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:08:47.823589  532182 download.go:100] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.16.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:2dad2c30ce283e38be90f005daed4074 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.16.0-containerd-overlay2-amd64.tar.lz4

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20211203020847-532170"

-- /stdout --

aaa_download_only_test.go:172: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

–

TestDownloadOnly/v1.22.4/json-events (6.97s)

=== RUN   TestDownloadOnly/v1.22.4/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.22.4 --container-runtime=containerd --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.22.4 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.966032501s)

--- PASS: TestDownloadOnly/v1.22.4/json-events (6.97s)

–

TestDownloadOnly/v1.22.4/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.22.4/preload-exists

--- PASS: TestDownloadOnly/v1.22.4/preload-exists (0.00s)

–

TestDownloadOnly/v1.22.4/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.22.4/LogsDuration

aaa_download_only_test.go:171: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20211203020847-532170

aaa_download_only_test.go:171: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20211203020847-532170: exit status 85 (68.55214ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:09:00

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:09:00.222898  532324 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:09:00.222997  532324 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:09:00.223006  532324 out.go:310] Setting ErrFile to fd 2...

	I1203 02:09:00.223009  532324 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:09:00.223107  532324 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	W1203 02:09:00.223228  532324 root.go:293] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: no such file or directory

	I1203 02:09:00.223312  532324 out.go:304] Setting JSON to true

	I1203 02:09:00.258514  532324 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":13901,"bootTime":1638483439,"procs":164,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:09:00.258609  532324 start.go:122] virtualization: kvm guest

	I1203 02:09:00.260907  532324 notify.go:174] Checking for updates...

	I1203 02:09:00.263083  532324 config.go:176] Loaded profile config "download-only-20211203020847-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0

	W1203 02:09:00.263141  532324 start.go:683] api.Load failed for download-only-20211203020847-532170: filestore "download-only-20211203020847-532170": Docker machine "download-only-20211203020847-532170" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I1203 02:09:00.263190  532324 driver.go:343] Setting default libvirt URI to qemu:///system

	W1203 02:09:00.263219  532324 start.go:683] api.Load failed for download-only-20211203020847-532170: filestore "download-only-20211203020847-532170": Docker machine "download-only-20211203020847-532170" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I1203 02:09:00.308689  532324 docker.go:132] docker version: linux-19.03.15

	I1203 02:09:00.308839  532324 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:09:00.385848  532324 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:09:00.342563052 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:09:00.385967  532324 docker.go:237] overlay module found

	I1203 02:09:00.388017  532324 start.go:280] selected driver: docker

	I1203 02:09:00.388029  532324 start.go:775] validating driver "docker" against &{Name:download-only-20211203020847-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-20211203020847-532170 Namespace:default APIServerName:minikubeCA

APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:09:00.388539  532324 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:09:00.467328  532324 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:09:00.422660095 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:09:00.467851  532324 cni.go:93] Creating CNI manager for ""

	I1203 02:09:00.467865  532324 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:09:00.467878  532324 start_flags.go:282] config:

	{Name:download-only-20211203020847-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:download-only-20211203020847-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:cont

ainerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:09:00.470029  532324 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:09:00.471577  532324 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:09:00.471615  532324 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1203 02:09:00.559430  532324 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1203 02:09:00.559464  532324 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1203 02:09:00.583321  532324 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4

	I1203 02:09:00.583358  532324 cache.go:57] Caching tarball of preloaded images

	I1203 02:09:00.583681  532324 preload.go:132] Checking if preload exists for k8s version v1.22.4 and runtime containerd

	I1203 02:09:00.585802  532324 preload.go:238] getting checksum for preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:09:00.699417  532324 download.go:100] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4?checksum=md5:c6e5a4e5f2b7370a6b3dc9a18dbaf0c7 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4

	I1203 02:09:04.954882  532324 preload.go:248] saving checksum for preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:09:04.954991  532324 preload.go:255] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-containerd-overlay2-amd64.tar.lz4 ...

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20211203020847-532170"

-- /stdout --

aaa_download_only_test.go:172: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.22.4/LogsDuration (0.07s)

–

TestDownloadOnly/v1.23.0-beta.0/json-events (25.96s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.23.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20211203020847-532170 --force --alsologtostderr --kubernetes-version=v1.23.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (25.962313007s)

--- PASS: TestDownloadOnly/v1.23.0-beta.0/json-events (25.96s)

–

TestDownloadOnly/v1.23.0-beta.0/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/preload-exists

--- PASS: TestDownloadOnly/v1.23.0-beta.0/preload-exists (0.00s)

–

TestDownloadOnly/v1.23.0-beta.0/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/LogsDuration

aaa_download_only_test.go:171: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20211203020847-532170

aaa_download_only_test.go:171: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20211203020847-532170: exit status 85 (68.547559ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/12/03 02:09:07

	Running on machine: debian-jenkins-agent-9

	Binary: Built with gc go1.17.3 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1203 02:09:07.258713  532465 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:09:07.258804  532465 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:09:07.258814  532465 out.go:310] Setting ErrFile to fd 2...

	I1203 02:09:07.258818  532465 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:09:07.258923  532465 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	W1203 02:09:07.259030  532465 root.go:293] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/config/config.json: no such file or directory

	I1203 02:09:07.259121  532465 out.go:304] Setting JSON to true

	I1203 02:09:07.295863  532465 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":13908,"bootTime":1638483439,"procs":162,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:09:07.295953  532465 start.go:122] virtualization: kvm guest

	I1203 02:09:07.298531  532465 notify.go:174] Checking for updates...

	I1203 02:09:07.300508  532465 config.go:176] Loaded profile config "download-only-20211203020847-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	W1203 02:09:07.300569  532465 start.go:683] api.Load failed for download-only-20211203020847-532170: filestore "download-only-20211203020847-532170": Docker machine "download-only-20211203020847-532170" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I1203 02:09:07.300631  532465 driver.go:343] Setting default libvirt URI to qemu:///system

	W1203 02:09:07.300675  532465 start.go:683] api.Load failed for download-only-20211203020847-532170: filestore "download-only-20211203020847-532170": Docker machine "download-only-20211203020847-532170" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I1203 02:09:07.346372  532465 docker.go:132] docker version: linux-19.03.15

	I1203 02:09:07.346537  532465 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:09:07.426111  532465 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:09:07.380943797 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:09:07.426194  532465 docker.go:237] overlay module found

	I1203 02:09:07.428154  532465 start.go:280] selected driver: docker

	I1203 02:09:07.428171  532465 start.go:775] validating driver "docker" against &{Name:download-only-20211203020847-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:download-only-20211203020847-532170 Namespace:default APIServerName:minikubeCA

APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:09:07.428755  532465 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:09:07.509335  532465 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:22 OomKillDisable:true NGoroutines:35 SystemTime:2021-12-03 02:09:07.464467487 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:09:07.510053  532465 cni.go:93] Creating CNI manager for ""

	I1203 02:09:07.510071  532465 cni.go:160] "docker" driver + containerd runtime found, recommending kindnet

	I1203 02:09:07.510086  532465 start_flags.go:282] config:

	{Name:download-only-20211203020847-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.0-beta.0 ClusterName:download-only-20211203020847-532170 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti

me:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:09:07.512170  532465 cache.go:118] Beginning downloading kic base image for docker with containerd

	I1203 02:09:07.513858  532465 preload.go:132] Checking if preload exists for k8s version v1.23.0-beta.0 and runtime containerd

	I1203 02:09:07.513942  532465 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1203 02:09:07.607226  532465 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1203 02:09:07.607257  532465 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1203 02:09:07.629907  532465 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4

	I1203 02:09:07.629947  532465 cache.go:57] Caching tarball of preloaded images

	I1203 02:09:07.630253  532465 preload.go:132] Checking if preload exists for k8s version v1.23.0-beta.0 and runtime containerd

	I1203 02:09:07.632313  532465 preload.go:238] getting checksum for preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:09:07.750099  532465 download.go:100] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:be275e5a44d5810bbb1677c1a9d75c61 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4

	I1203 02:09:30.249779  532465 preload.go:248] saving checksum for preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:09:30.249955  532465 preload.go:255] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.23.0-beta.0-containerd-overlay2-amd64.tar.lz4 ...

	I1203 02:09:31.606754  532465 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.0-beta.0 on containerd

	I1203 02:09:31.606901  532465 profile.go:147] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/download-only-20211203020847-532170/config.json ...

	I1203 02:09:31.607106  532465 preload.go:132] Checking if preload exists for k8s version v1.23.0-beta.0 and runtime containerd

	I1203 02:09:31.607371  532465 download.go:100] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.23.0-beta.0/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.23.0-beta.0/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/cache/linux/v1.23.0-beta.0/kubectl

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20211203020847-532170"

-- /stdout --

aaa_download_only_test.go:172: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.23.0-beta.0/LogsDuration (0.07s)

–

TestDownloadOnly/DeleteAll (0.4s)

=== RUN   TestDownloadOnly/DeleteAll

aaa_download_only_test.go:189: (dbg) Run:  out/minikube-linux-amd64 delete --all

--- PASS: TestDownloadOnly/DeleteAll (0.40s)

–

TestDownloadOnly/DeleteAlwaysSucceeds (0.24s)

=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds

aaa_download_only_test.go:201: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-20211203020847-532170

--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.24s)

–

TestDownloadOnlyKic (18.83s)

=== RUN   TestDownloadOnlyKic

aaa_download_only_test.go:226: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-20211203020934-532170 --force --alsologtostderr --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:226: (dbg) Done: out/minikube-linux-amd64 start --download-only -p download-docker-20211203020934-532170 --force --alsologtostderr --driver=docker  --container-runtime=containerd: (17.327703175s)

helpers_test.go:176: Cleaning up "download-docker-20211203020934-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-20211203020934-532170

--- PASS: TestDownloadOnlyKic (18.83s)

–

TestOffline (84.9s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

=== CONT  TestOffline

aab_offline_test.go:56: (dbg) Run:  out/minikube-linux-amd64 start -p offline-containerd-20211203024124-532170 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd

=== CONT  TestOffline

aab_offline_test.go:56: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-20211203024124-532170 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=containerd: (1m21.189105996s)

helpers_test.go:176: Cleaning up "offline-containerd-20211203024124-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-containerd-20211203024124-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-20211203024124-532170: (3.709257417s)

--- PASS: TestOffline (84.90s)

–

TestAddons/Setup (134.81s)

=== RUN   TestAddons/Setup

addons_test.go:76: (dbg) Run:  out/minikube-linux-amd64 start -p addons-20211203020952-532170 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:76: (dbg) Done: out/minikube-linux-amd64 start -p addons-20211203020952-532170 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m14.810514132s)

--- PASS: TestAddons/Setup (134.81s)

–

TestAddons/parallel/Registry (25.14s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:281: registry stabilized in 12.956959ms

=== CONT  TestAddons/parallel/Registry

addons_test.go:283: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

=== CONT  TestAddons/parallel/Registry

helpers_test.go:343: "registry-cqbc9" [7503593b-335c-49fd-8d29-9d251fb1384c] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:283: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.014009477s

addons_test.go:286: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:343: "registry-proxy-85whk" [726ab4c3-b49a-40ae-b66e-f78745f72c17] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:286: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.926623181s

addons_test.go:291: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete po -l run=registry-test --now

=== CONT  TestAddons/parallel/Registry

addons_test.go:296: (dbg) Run:  kubectl --context addons-20211203020952-532170 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

=== CONT  TestAddons/parallel/Registry

addons_test.go:296: (dbg) Done: kubectl --context addons-20211203020952-532170 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (12.995064887s)

addons_test.go:310: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 ip

2021/12/03 02:12:32 [DEBUG] GET http://192.168.49.2:5000

addons_test.go:339: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable registry --alsologtostderr -v=1

--- PASS: TestAddons/parallel/Registry (25.14s)

–

TestAddons/parallel/Ingress (47.04s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:163: (dbg) Run:  kubectl --context addons-20211203020952-532170 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:183: (dbg) Run:  kubectl --context addons-20211203020952-532170 replace --force -f testdata/nginx-ingress-v1.yaml

=== CONT  TestAddons/parallel/Ingress

addons_test.go:183: (dbg) Done: kubectl --context addons-20211203020952-532170 replace --force -f testdata/nginx-ingress-v1.yaml: (1.596525915s)

addons_test.go:196: (dbg) Run:  kubectl --context addons-20211203020952-532170 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:201: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:343: "nginx" [b9bc8974-2329-4c87-97bd-305caa5599a9] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

=== CONT  TestAddons/parallel/Ingress

helpers_test.go:343: "nginx" [b9bc8974-2329-4c87-97bd-305caa5599a9] Running

=== CONT  TestAddons/parallel/Ingress

addons_test.go:201: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 14.008765948s

addons_test.go:213: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:237: (dbg) Run:  kubectl --context addons-20211203020952-532170 replace --force -f testdata/ingress-dns-example-v1.yaml

addons_test.go:242: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 ip

addons_test.go:248: (dbg) Run:  nslookup hello-john.test 192.168.49.2

addons_test.go:257: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:262: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable ingress --alsologtostderr -v=1

=== CONT  TestAddons/parallel/Ingress

addons_test.go:262: (dbg) Done: out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable ingress --alsologtostderr -v=1: (29.164376333s)

--- PASS: TestAddons/parallel/Ingress (47.04s)

–

TestAddons/parallel/MetricsServer (5.69s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:358: metrics-server stabilized in 14.077739ms

addons_test.go:360: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

=== CONT  TestAddons/parallel/MetricsServer

helpers_test.go:343: "metrics-server-77c99ccb96-f2ng2" [0ed8c9d7-8574-4e04-959a-d457311ff410] Running

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:360: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.013480705s

addons_test.go:366: (dbg) Run:  kubectl --context addons-20211203020952-532170 top pods -n kube-system

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:383: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable metrics-server --alsologtostderr -v=1

--- PASS: TestAddons/parallel/MetricsServer (5.69s)

–

TestAddons/parallel/HelmTiller (17.97s)

=== RUN   TestAddons/parallel/HelmTiller

=== PAUSE TestAddons/parallel/HelmTiller

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:407: tiller-deploy stabilized in 44.111821ms

addons_test.go:409: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

helpers_test.go:343: "tiller-deploy-64b546c44b-lwrfm" [58fd85c1-2ce5-4282-bd8a-7f6c8e8e56d9] Running

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:409: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.23070035s

addons_test.go:424: (dbg) Run:  kubectl --context addons-20211203020952-532170 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:424: (dbg) Done: kubectl --context addons-20211203020952-532170 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (12.018776823s)

addons_test.go:429: kubectl --context addons-20211203020952-532170 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: unexpected stderr: Unable to use a TTY - input is not a terminal or the right kind of file

If you don't see a command prompt, try pressing enter.

Error attaching, falling back to logs:

addons_test.go:441: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable helm-tiller --alsologtostderr -v=1

--- PASS: TestAddons/parallel/HelmTiller (17.97s)

–

TestAddons/parallel/Olm (45.62s)

=== RUN   TestAddons/parallel/Olm

=== PAUSE TestAddons/parallel/Olm

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20211203020952-532170 wait --for=condition=ready --namespace=olm pod --selector=app=catalog-operator --timeout=90s

=== CONT  TestAddons/parallel/Olm

addons_test.go:456: catalog-operator stabilized in 217.951383ms

addons_test.go:458: (dbg) Run:  kubectl --context addons-20211203020952-532170 wait --for=condition=ready --namespace=olm pod --selector=app=olm-operator --timeout=90s

addons_test.go:461: olm-operator stabilized in 290.593776ms

addons_test.go:463: (dbg) Run:  kubectl --context addons-20211203020952-532170 wait --for=condition=ready --namespace=olm pod --selector=app=packageserver --timeout=90s

addons_test.go:466: packageserver stabilized in 376.639179ms

addons_test.go:468: (dbg) Run:  kubectl --context addons-20211203020952-532170 wait --for=condition=ready --namespace=olm pod --selector=olm.catalogSource=operatorhubio-catalog --timeout=90s

addons_test.go:471: operatorhubio-catalog stabilized in 439.949588ms

addons_test.go:474: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/etcd.yaml

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

addons_test.go:486: kubectl --context addons-20211203020952-532170 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

addons_test.go:486: kubectl --context addons-20211203020952-532170 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

addons_test.go:481: (dbg) Done: kubectl --context addons-20211203020952-532170 get csv -n my-etcd: (1.21468138s)

addons_test.go:486: kubectl --context addons-20211203020952-532170 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

addons_test.go:486: kubectl --context addons-20211203020952-532170 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

=== CONT  TestAddons/parallel/Olm

addons_test.go:481: (dbg) Run:  kubectl --context addons-20211203020952-532170 get csv -n my-etcd

--- PASS: TestAddons/parallel/Olm (45.62s)

–

TestAddons/parallel/CSI (52.16s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:512: csi-hostpath-driver pods stabilized in 18.436388ms

addons_test.go:515: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/pvc.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:520: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20211203020952-532170 get pvc hpvc -o jsonpath={.status.phase} -n default

=== CONT  TestAddons/parallel/CSI

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20211203020952-532170 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:525: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/pv-pod.yaml

addons_test.go:530: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:343: "task-pv-pod" [3c7b78fa-51ae-4b62-94a7-c845b7d53692] Pending

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod" [3c7b78fa-51ae-4b62-94a7-c845b7d53692] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod" [3c7b78fa-51ae-4b62-94a7-c845b7d53692] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:530: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 16.037730865s

addons_test.go:535: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:535: (dbg) Done: kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/snapshot.yaml: (2.996519869s)

addons_test.go:540: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:418: (dbg) Run:  kubectl --context addons-20211203020952-532170 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:418: (dbg) Run:  kubectl --context addons-20211203020952-532170 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:545: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete pod task-pv-pod

=== CONT  TestAddons/parallel/CSI

addons_test.go:551: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete pvc hpvc

addons_test.go:557: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:557: (dbg) Done: kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/pvc-restore.yaml: (1.783896379s)

addons_test.go:562: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20211203020952-532170 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

=== CONT  TestAddons/parallel/CSI

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20211203020952-532170 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:567: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:572: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:343: "task-pv-pod-restore" [baf263dc-8b0f-4d41-a74c-74b29191dc62] Pending

helpers_test.go:343: "task-pv-pod-restore" [baf263dc-8b0f-4d41-a74c-74b29191dc62] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod-restore" [baf263dc-8b0f-4d41-a74c-74b29191dc62] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:572: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 17.006153275s

addons_test.go:577: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete pod task-pv-pod-restore

addons_test.go:581: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete pvc hpvc-restore

addons_test.go:585: (dbg) Run:  kubectl --context addons-20211203020952-532170 delete volumesnapshot new-snapshot-demo

addons_test.go:589: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable csi-hostpath-driver --alsologtostderr -v=1

=== CONT  TestAddons/parallel/CSI

addons_test.go:589: (dbg) Done: out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable csi-hostpath-driver --alsologtostderr -v=1: (7.053707271s)

addons_test.go:593: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable volumesnapshots --alsologtostderr -v=1

--- PASS: TestAddons/parallel/CSI (52.16s)

–

TestAddons/serial/GCPAuth (46.14s)

=== RUN   TestAddons/serial/GCPAuth

addons_test.go:604: (dbg) Run:  kubectl --context addons-20211203020952-532170 create -f testdata/busybox.yaml

addons_test.go:610: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [1cec6f36-8c8d-4eed-8c01-28c014eca005] Pending

helpers_test.go:343: "busybox" [1cec6f36-8c8d-4eed-8c01-28c014eca005] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [1cec6f36-8c8d-4eed-8c01-28c014eca005] Running

addons_test.go:610: (dbg) TestAddons/serial/GCPAuth: integration-test=busybox healthy within 10.01077242s

addons_test.go:616: (dbg) Run:  kubectl --context addons-20211203020952-532170 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"

addons_test.go:653: (dbg) Run:  kubectl --context addons-20211203020952-532170 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"

addons_test.go:666: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable gcp-auth --alsologtostderr -v=1

addons_test.go:666: (dbg) Done: out/minikube-linux-amd64 -p addons-20211203020952-532170 addons disable gcp-auth --alsologtostderr -v=1: (6.625167998s)

addons_test.go:682: (dbg) Run:  out/minikube-linux-amd64 -p addons-20211203020952-532170 addons enable gcp-auth

addons_test.go:682: (dbg) Done: out/minikube-linux-amd64 -p addons-20211203020952-532170 addons enable gcp-auth: (3.9577493s)

addons_test.go:688: (dbg) Run:  kubectl --context addons-20211203020952-532170 apply -f testdata/private-image.yaml

addons_test.go:695: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image" in namespace "default" ...

helpers_test.go:343: "private-image-7ff9c8c74f-2qcjc" [d6eef51b-a431-4d85-8bc8-d667356a24c1] Pending / Ready:ContainersNotReady (containers with unready status: [private-image]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image])

helpers_test.go:343: "private-image-7ff9c8c74f-2qcjc" [d6eef51b-a431-4d85-8bc8-d667356a24c1] Running

addons_test.go:695: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image healthy within 17.009116784s

addons_test.go:701: (dbg) Run:  kubectl --context addons-20211203020952-532170 apply -f testdata/private-image-eu.yaml

addons_test.go:706: (dbg) TestAddons/serial/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image-eu" in namespace "default" ...

helpers_test.go:343: "private-image-eu-5956d58f9f-52nqs" [d2614de1-2cf6-48cb-806c-01165651cc5e] Pending / Ready:ContainersNotReady (containers with unready status: [private-image-eu]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image-eu])

helpers_test.go:343: "private-image-eu-5956d58f9f-52nqs" [d2614de1-2cf6-48cb-806c-01165651cc5e] Running

addons_test.go:706: (dbg) TestAddons/serial/GCPAuth: integration-test=private-image-eu healthy within 7.006302366s

--- PASS: TestAddons/serial/GCPAuth (46.14s)

–

TestAddons/StoppedEnableDisable (20.87s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:133: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-20211203020952-532170

addons_test.go:133: (dbg) Done: out/minikube-linux-amd64 stop -p addons-20211203020952-532170: (20.667021529s)

addons_test.go:137: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-20211203020952-532170

addons_test.go:141: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-20211203020952-532170

--- PASS: TestAddons/StoppedEnableDisable (20.87s)

–

TestCertOptions (49.25s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:50: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-20211203024559-532170 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd

cert_options_test.go:50: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-20211203024559-532170 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (44.396665154s)

cert_options_test.go:61: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-20211203024559-532170 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:89: (dbg) Run:  kubectl --context cert-options-20211203024559-532170 config view

cert_options_test.go:101: (dbg) Run:  out/minikube-linux-amd64 ssh -p cert-options-20211203024559-532170 -- "sudo cat /etc/kubernetes/admin.conf"

helpers_test.go:176: Cleaning up "cert-options-20211203024559-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-20211203024559-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-20211203024559-532170: (4.060300374s)

--- PASS: TestCertOptions (49.25s)

–

TestCertExpiration (278.63s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:124: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-20211203024426-532170 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd

=== CONT  TestCertExpiration

cert_options_test.go:124: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-20211203024426-532170 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (44.883916885s)

=== CONT  TestCertExpiration

cert_options_test.go:132: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-20211203024426-532170 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd

=== CONT  TestCertExpiration

cert_options_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-20211203024426-532170 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (50.46430421s)

helpers_test.go:176: Cleaning up "cert-expiration-20211203024426-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-expiration-20211203024426-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-20211203024426-532170: (3.280337103s)

--- PASS: TestCertExpiration (278.63s)

–

TestForceSystemdFlag (246.25s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:86: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-20211203024401-532170 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

=== CONT  TestForceSystemdFlag

docker_test.go:86: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-20211203024401-532170 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (4m2.48716384s)

docker_test.go:116: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-20211203024401-532170 ssh "cat /etc/containerd/config.toml"

helpers_test.go:176: Cleaning up "force-systemd-flag-20211203024401-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-20211203024401-532170

E1203 02:48:05.912052  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-20211203024401-532170: (3.335996316s)

--- PASS: TestForceSystemdFlag (246.25s)

–

TestForceSystemdEnv (52.65s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:151: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-20211203024249-532170 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

=== CONT  TestForceSystemdEnv

docker_test.go:151: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-20211203024249-532170 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (49.169334879s)

docker_test.go:116: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-20211203024249-532170 ssh "cat /etc/containerd/config.toml"

helpers_test.go:176: Cleaning up "force-systemd-env-20211203024249-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-20211203024249-532170

=== CONT  TestForceSystemdEnv

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-20211203024249-532170: (3.063798172s)

--- PASS: TestForceSystemdEnv (52.65s)

–

TestKVMDriverInstallOrUpdate (7.75s)

=== RUN   TestKVMDriverInstallOrUpdate

=== PAUSE TestKVMDriverInstallOrUpdate

=== CONT  TestKVMDriverInstallOrUpdate

E1203 02:42:07.765281  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

--- PASS: TestKVMDriverInstallOrUpdate (7.75s)

–

TestErrorSpam/setup (41.43s)

=== RUN   TestErrorSpam/setup

error_spam_test.go:79: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-20211203021432-532170 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20211203021432-532170 --driver=docker  --container-runtime=containerd

error_spam_test.go:79: (dbg) Done: out/minikube-linux-amd64 start -p nospam-20211203021432-532170 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20211203021432-532170 --driver=docker  --container-runtime=containerd: (41.427635959s)

error_spam_test.go:89: acceptable stderr: "! Your cgroup does not allow setting memory."

error_spam_test.go:89: acceptable stderr: "! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.4."

--- PASS: TestErrorSpam/setup (41.43s)

–

TestErrorSpam/start (0.97s)

=== RUN   TestErrorSpam/start

error_spam_test.go:214: Cleaning up 1 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 start --dry-run

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 start --dry-run

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 start --dry-run

--- PASS: TestErrorSpam/start (0.97s)

–

TestErrorSpam/status (1.19s)

=== RUN   TestErrorSpam/status

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 status

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 status

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 status

--- PASS: TestErrorSpam/status (1.19s)

–

TestErrorSpam/pause (1.54s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 pause

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 pause

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 pause

--- PASS: TestErrorSpam/pause (1.54s)

–

TestErrorSpam/unpause (1.5s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 unpause

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 unpause

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 unpause

--- PASS: TestErrorSpam/unpause (1.50s)

–

TestErrorSpam/stop (23.62s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 stop

error_spam_test.go:157: (dbg) Done: out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 stop: (23.334998785s)

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 stop

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20211203021432-532170 --log_dir /tmp/nospam-20211203021432-532170 stop

--- PASS: TestErrorSpam/stop (23.62s)

–

TestFunctional/serial/CopySyncFile (0s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1685: local sync path: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/files/etc/test/nested/copy/532170/hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

–

TestFunctional/serial/StartWithProxy (65.44s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2067: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd

functional_test.go:2067: (dbg) Done: out/minikube-linux-amd64 start -p functional-20211203021548-532170 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m5.437299113s)

--- PASS: TestFunctional/serial/StartWithProxy (65.44s)

–

TestFunctional/serial/AuditLog (0s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

–

TestFunctional/serial/SoftStart (15.58s)

=== RUN   TestFunctional/serial/SoftStart

functional_test.go:637: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --alsologtostderr -v=8

E1203 02:17:07.765736  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:07.771625  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:07.781936  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:07.802255  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:07.842578  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:07.923647  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:08.084084  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:08.405038  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:09.045900  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

functional_test.go:637: (dbg) Done: out/minikube-linux-amd64 start -p functional-20211203021548-532170 --alsologtostderr -v=8: (15.58044346s)

functional_test.go:641: soft start took 15.581045093s for "functional-20211203021548-532170" cluster.

--- PASS: TestFunctional/serial/SoftStart (15.58s)

–

TestFunctional/serial/KubeContext (0.04s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:659: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.04s)

–

TestFunctional/serial/KubectlGetPods (0.17s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:674: (dbg) Run:  kubectl --context functional-20211203021548-532170 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.17s)

–

TestFunctional/serial/CacheCmd/cache/add_remote (3.55s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1020: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add k8s.gcr.io/pause:3.1

functional_test.go:1020: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add k8s.gcr.io/pause:3.3

E1203 02:17:10.326240  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

functional_test.go:1020: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add k8s.gcr.io/pause:3.3: (1.698511752s)

functional_test.go:1020: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add k8s.gcr.io/pause:latest

E1203 02:17:12.886883  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

functional_test.go:1020: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add k8s.gcr.io/pause:latest: (1.159573267s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.55s)

–

TestFunctional/serial/CacheCmd/cache/add_local (2.34s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_local

functional_test.go:1051: (dbg) Run:  docker build -t minikube-local-cache-test:functional-20211203021548-532170 /tmp/functional-20211203021548-5321701784843382

functional_test.go:1063: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add minikube-local-cache-test:functional-20211203021548-532170

functional_test.go:1063: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 cache add minikube-local-cache-test:functional-20211203021548-532170: (2.0367933s)

functional_test.go:1068: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache delete minikube-local-cache-test:functional-20211203021548-532170

functional_test.go:1057: (dbg) Run:  docker rmi minikube-local-cache-test:functional-20211203021548-532170

--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (2.34s)

–

TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3

functional_test.go:1076: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.3

--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.06s)

–

TestFunctional/serial/CacheCmd/cache/list (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1084: (dbg) Run:  out/minikube-linux-amd64 cache list

--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

–

TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.37s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1098: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh sudo crictl images

--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.37s)

–

TestFunctional/serial/CacheCmd/cache/cache_reload (2.02s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1121: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh sudo crictl rmi k8s.gcr.io/pause:latest

functional_test.go:1127: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

functional_test.go:1127: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (364.346308ms)

-- stdout --

	[31mFATA[0m[0000] no such image "k8s.gcr.io/pause:latest" present

-- /stdout --

** stderr **

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1132: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cache reload

functional_test.go:1137: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.02s)

–

TestFunctional/serial/CacheCmd/cache/delete (0.12s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1146: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.1

functional_test.go:1146: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

–

TestFunctional/serial/MinikubeKubectlCmd (0.11s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmd

functional_test.go:694: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 kubectl -- --context functional-20211203021548-532170 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.11s)

–

TestFunctional/serial/MinikubeKubectlCmdDirectly (0.1s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly

functional_test.go:719: (dbg) Run:  out/kubectl --context functional-20211203021548-532170 get pods

E1203 02:17:18.008030  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.10s)

–

TestFunctional/serial/ExtraConfig (45.09s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:735: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

E1203 02:17:28.248279  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:17:48.728526  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

functional_test.go:735: (dbg) Done: out/minikube-linux-amd64 start -p functional-20211203021548-532170 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (45.091573723s)

functional_test.go:739: restart took 45.091698582s for "functional-20211203021548-532170" cluster.

--- PASS: TestFunctional/serial/ExtraConfig (45.09s)

–

TestFunctional/serial/ComponentHealth (0.07s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:789: (dbg) Run:  kubectl --context functional-20211203021548-532170 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:804: etcd phase: Running

functional_test.go:814: etcd status: Ready

functional_test.go:804: kube-apiserver phase: Running

functional_test.go:814: kube-apiserver status: Ready

functional_test.go:804: kube-controller-manager phase: Running

functional_test.go:814: kube-controller-manager status: Ready

functional_test.go:804: kube-scheduler phase: Running

functional_test.go:814: kube-scheduler status: Ready

--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

–

TestFunctional/serial/LogsCmd (1.12s)

=== RUN   TestFunctional/serial/LogsCmd

functional_test.go:1210: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 logs

functional_test.go:1210: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 logs: (1.118951061s)

--- PASS: TestFunctional/serial/LogsCmd (1.12s)

–

TestFunctional/serial/LogsFileCmd (1.11s)

=== RUN   TestFunctional/serial/LogsFileCmd

functional_test.go:1227: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 logs --file /tmp/functional-20211203021548-5321701640178430/logs.txt

functional_test.go:1227: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 logs --file /tmp/functional-20211203021548-5321701640178430/logs.txt: (1.108507673s)

--- PASS: TestFunctional/serial/LogsFileCmd (1.11s)

–

TestFunctional/parallel/ConfigCmd (0.43s)

=== RUN   TestFunctional/parallel/ConfigCmd

=== PAUSE TestFunctional/parallel/ConfigCmd

=== CONT  TestFunctional/parallel/ConfigCmd

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config unset cpus

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config get cpus

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1173: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 config get cpus: exit status 14 (65.735778ms)

** stderr **

	Error: specified key could not be found in config

** /stderr **

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config set cpus 2

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config get cpus

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config unset cpus

functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 config get cpus

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1173: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 config get cpus: exit status 14 (59.772447ms)

** stderr **

	Error: specified key could not be found in config

** /stderr **

--- PASS: TestFunctional/parallel/ConfigCmd (0.43s)

–

TestFunctional/parallel/DashboardCmd (4.24s)

=== RUN   TestFunctional/parallel/DashboardCmd

=== PAUSE TestFunctional/parallel/DashboardCmd

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:884: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20211203021548-532170 --alsologtostderr -v=1]

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:889: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20211203021548-532170 --alsologtostderr -v=1] ...

helpers_test.go:507: unable to kill pid 567897: os: process already finished

--- PASS: TestFunctional/parallel/DashboardCmd (4.24s)

–

TestFunctional/parallel/DryRun (0.65s)

=== RUN   TestFunctional/parallel/DryRun

=== PAUSE TestFunctional/parallel/DryRun

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:949: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:949: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20211203021548-532170 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (273.400808ms)

-- stdout --

	* [functional-20211203021548-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

	* Using the docker driver based on existing profile

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

-- /stdout --

** stderr **

	I1203 02:18:24.270224  566864 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:18:24.270301  566864 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:18:24.270305  566864 out.go:310] Setting ErrFile to fd 2...

	I1203 02:18:24.270309  566864 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:18:24.270413  566864 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:18:24.270637  566864 out.go:304] Setting JSON to false

	I1203 02:18:24.310136  566864 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":14465,"bootTime":1638483439,"procs":233,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:18:24.310254  566864 start.go:122] virtualization: kvm guest

	I1203 02:18:24.313072  566864 out.go:176] * [functional-20211203021548-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:18:24.314810  566864 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:18:24.316429  566864 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:18:24.318064  566864 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:18:24.319641  566864 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:18:24.320198  566864 config.go:176] Loaded profile config "functional-20211203021548-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:18:24.320868  566864 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:18:24.376228  566864 docker.go:132] docker version: linux-19.03.15

	I1203 02:18:24.376312  566864 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:18:24.470208  566864 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:223 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:30 OomKillDisable:true NGoroutines:40 SystemTime:2021-12-03 02:18:24.418253479 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:18:24.470293  566864 docker.go:237] overlay module found

	I1203 02:18:24.472532  566864 out.go:176] * Using the docker driver based on existing profile

	I1203 02:18:24.472569  566864 start.go:280] selected driver: docker

	I1203 02:18:24.472575  566864 start.go:775] validating driver "docker" against &{Name:functional-20211203021548-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:functional-20211203021548-532170 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision} {Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-ali

ases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:18:24.472717  566864 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:18:24.472762  566864 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:18:24.472778  566864 out.go:241] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I1203 02:18:24.474199  566864 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:18:24.476392  566864 out.go:176]

	W1203 02:18:24.476567  566864 out.go:241] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	I1203 02:18:24.478126  566864 out.go:176]

** /stderr **

functional_test.go:966: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

--- PASS: TestFunctional/parallel/DryRun (0.65s)

–

TestFunctional/parallel/InternationalLanguage (0.29s)

=== RUN   TestFunctional/parallel/InternationalLanguage

=== PAUSE TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:991: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20211203021548-532170 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

functional_test.go:991: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20211203021548-532170 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (291.270715ms)

-- stdout --

	* [functional-20211203021548-532170] minikube v1.24.0 sur Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

	* Utilisation du pilote docker basé sur le profil existant

	  - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

-- /stdout --

** stderr **

	I1203 02:18:15.485199  564396 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:18:15.485277  564396 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:18:15.485282  564396 out.go:310] Setting ErrFile to fd 2...

	I1203 02:18:15.485285  564396 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:18:15.485462  564396 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:18:15.485733  564396 out.go:304] Setting JSON to false

	I1203 02:18:15.528377  564396 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":14456,"bootTime":1638483439,"procs":219,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:18:15.528561  564396 start.go:122] virtualization: kvm guest

	I1203 02:18:15.531043  564396 out.go:176] * [functional-20211203021548-532170] minikube v1.24.0 sur Debian 9.13 (kvm/amd64)

	I1203 02:18:15.532944  564396 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:18:15.534561  564396 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:18:15.536080  564396 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:18:15.537898  564396 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:18:15.538407  564396 config.go:176] Loaded profile config "functional-20211203021548-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:18:15.538789  564396 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:18:15.599473  564396 docker.go:132] docker version: linux-19.03.15

	I1203 02:18:15.599582  564396 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:18:15.704156  564396 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:223 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:44 SystemTime:2021-12-03 02:18:15.644603025 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:18:15.704276  564396 docker.go:237] overlay module found

	I1203 02:18:15.706923  564396 out.go:176] * Utilisation du pilote docker basé sur le profil existant

	I1203 02:18:15.706953  564396 start.go:280] selected driver: docker

	I1203 02:18:15.706960  564396 start.go:775] validating driver "docker" against &{Name:functional-20211203021548-532170 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4 ClusterName:functional-20211203021548-532170 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision} {Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.4 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-ali

ases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host}

	I1203 02:18:15.707111  564396 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:18:15.707162  564396 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:18:15.707190  564396 out.go:241] ! Votre groupe de contrôle ne permet pas de définir la mémoire.

	! Votre groupe de contrôle ne permet pas de définir la mémoire.

	I1203 02:18:15.708962  564396 out.go:176]   - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:18:15.711904  564396 out.go:176]

	W1203 02:18:15.712030  564396 out.go:241] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	I1203 02:18:15.713663  564396 out.go:176]

** /stderr **

--- PASS: TestFunctional/parallel/InternationalLanguage (0.29s)

–

TestFunctional/parallel/StatusCmd (1.6s)

=== RUN   TestFunctional/parallel/StatusCmd

=== PAUSE TestFunctional/parallel/StatusCmd

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:833: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 status

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:839: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:851: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 status -o json

--- PASS: TestFunctional/parallel/StatusCmd (1.60s)

–

TestFunctional/parallel/ServiceCmd (16.08s)

=== RUN   TestFunctional/parallel/ServiceCmd

=== PAUSE TestFunctional/parallel/ServiceCmd

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1409: (dbg) Run:  kubectl --context functional-20211203021548-532170 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1415: (dbg) Run:  kubectl --context functional-20211203021548-532170 expose deployment hello-node --type=NodePort --port=8080

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1420: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...

helpers_test.go:343: "hello-node-6cbfcd7cbc-hhtx9" [aedab6c1-9fa4-4a0c-8325-9171ec6b343d] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

=== CONT  TestFunctional/parallel/ServiceCmd

helpers_test.go:343: "hello-node-6cbfcd7cbc-hhtx9" [aedab6c1-9fa4-4a0c-8325-9171ec6b343d] Running

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1420: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 14.006240214s

functional_test.go:1425: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 service list

functional_test.go:1438: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 service --namespace=default --https --url hello-node

functional_test.go:1447: found endpoint: https://192.168.49.2:32185

functional_test.go:1458: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 service hello-node --url --format={{.IP}}

functional_test.go:1467: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 service hello-node --url

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1473: found endpoint for hello-node: http://192.168.49.2:32185

functional_test.go:1484: Attempting to fetch http://192.168.49.2:32185 ...

functional_test.go:1504: http://192.168.49.2:32185: success! body:

Hostname: hello-node-6cbfcd7cbc-hhtx9

Pod Information:

	-no pod information available-

Server values:

	server_version=nginx: 1.13.3 - lua: 10008

Request Information:

	client_address=10.244.0.1

	method=GET

	real path=/

	query=

	request_version=1.1

	request_uri=http://192.168.49.2:8080/

Request Headers:

	accept-encoding=gzip

	host=192.168.49.2:32185

	user-agent=Go-http-client/1.1

Request Body:

	-no body in request-

--- PASS: TestFunctional/parallel/ServiceCmd (16.08s)

–

TestFunctional/parallel/AddonsCmd (0.17s)

=== RUN   TestFunctional/parallel/AddonsCmd

=== PAUSE TestFunctional/parallel/AddonsCmd

=== CONT  TestFunctional/parallel/AddonsCmd

functional_test.go:1519: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 addons list

functional_test.go:1531: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 addons list -o json

--- PASS: TestFunctional/parallel/AddonsCmd (0.17s)

–

TestFunctional/parallel/PersistentVolumeClaim (29.37s)

=== RUN   TestFunctional/parallel/PersistentVolumeClaim

=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...

helpers_test.go:343: "storage-provisioner" [77c0c3a1-564f-4100-86d6-0dab82a5e6aa] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.007520184s

functional_test_pvc_test.go:50: (dbg) Run:  kubectl --context functional-20211203021548-532170 get storageclass -o=json

functional_test_pvc_test.go:70: (dbg) Run:  kubectl --context functional-20211203021548-532170 apply -f testdata/storage-provisioner/pvc.yaml

functional_test_pvc_test.go:77: (dbg) Run:  kubectl --context functional-20211203021548-532170 get pvc myclaim -o=json

functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20211203021548-532170 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:343: "sp-pod" [d9f6f2b9-6429-4e80-8400-37a0bb84ec18] Pending

helpers_test.go:343: "sp-pod" [d9f6f2b9-6429-4e80-8400-37a0bb84ec18] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [d9f6f2b9-6429-4e80-8400-37a0bb84ec18] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 13.010158494s

functional_test_pvc_test.go:101: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec sp-pod -- touch /tmp/mount/foo

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:107: (dbg) Run:  kubectl --context functional-20211203021548-532170 delete -f testdata/storage-provisioner/pod.yaml

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:107: (dbg) Done: kubectl --context functional-20211203021548-532170 delete -f testdata/storage-provisioner/pod.yaml: (1.112520783s)

functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20211203021548-532170 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:343: "sp-pod" [d99f5010-8990-4dec-a635-b0578991df54] Pending

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [d99f5010-8990-4dec-a635-b0578991df54] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [d99f5010-8990-4dec-a635-b0578991df54] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.0109571s

functional_test_pvc_test.go:115: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec sp-pod -- ls /tmp/mount

--- PASS: TestFunctional/parallel/PersistentVolumeClaim (29.37s)

–

TestFunctional/parallel/SSHCmd (0.86s)

=== RUN   TestFunctional/parallel/SSHCmd

=== PAUSE TestFunctional/parallel/SSHCmd

=== CONT  TestFunctional/parallel/SSHCmd

=== CONT  TestFunctional/parallel/SSHCmd

functional_test.go:1554: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "echo hello"

=== CONT  TestFunctional/parallel/SSHCmd

functional_test.go:1571: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "cat /etc/hostname"

--- PASS: TestFunctional/parallel/SSHCmd (0.86s)

–

TestFunctional/parallel/CpCmd (1.45s)

=== RUN   TestFunctional/parallel/CpCmd

=== PAUSE TestFunctional/parallel/CpCmd

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cp testdata/cp-test.txt /home/docker/cp-test.txt

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh -n functional-20211203021548-532170 "sudo cat /home/docker/cp-test.txt"

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 cp functional-20211203021548-532170:/home/docker/cp-test.txt /tmp/mk_test2502383597/cp-test.txt

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh -n functional-20211203021548-532170 "sudo cat /home/docker/cp-test.txt"

--- PASS: TestFunctional/parallel/CpCmd (1.45s)

–

TestFunctional/parallel/MySQL (22.58s)

=== RUN   TestFunctional/parallel/MySQL

=== PAUSE TestFunctional/parallel/MySQL

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1623: (dbg) Run:  kubectl --context functional-20211203021548-532170 replace --force -f testdata/mysql.yaml

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1629: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...

helpers_test.go:343: "mysql-9bbbc5bbb-jw8fb" [7864a6c6-b62d-4465-9eaf-9737b4b55a40] Pending

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:343: "mysql-9bbbc5bbb-jw8fb" [7864a6c6-b62d-4465-9eaf-9737b4b55a40] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:343: "mysql-9bbbc5bbb-jw8fb" [7864a6c6-b62d-4465-9eaf-9737b4b55a40] Running

functional_test.go:1629: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 16.008545206s

functional_test.go:1637: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;"

functional_test.go:1637: (dbg) Non-zero exit: kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;": exit status 1 (196.172179ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

	command terminated with exit code 1

** /stderr **

functional_test.go:1637: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;"

functional_test.go:1637: (dbg) Non-zero exit: kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;": exit status 1 (142.920698ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)

	command terminated with exit code 1

** /stderr **

functional_test.go:1637: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;"

functional_test.go:1637: (dbg) Non-zero exit: kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;": exit status 1 (182.600634ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)

	command terminated with exit code 1

** /stderr **

functional_test.go:1637: (dbg) Run:  kubectl --context functional-20211203021548-532170 exec mysql-9bbbc5bbb-jw8fb -- mysql -ppassword -e "show databases;"

--- PASS: TestFunctional/parallel/MySQL (22.58s)

–

TestFunctional/parallel/FileSync (0.59s)

=== RUN   TestFunctional/parallel/FileSync

=== PAUSE TestFunctional/parallel/FileSync

=== CONT  TestFunctional/parallel/FileSync

functional_test.go:1759: Checking for existence of /etc/test/nested/copy/532170/hosts within VM

functional_test.go:1761: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /etc/test/nested/copy/532170/hosts"

=== CONT  TestFunctional/parallel/FileSync

functional_test.go:1766: file sync test content: Test file for checking file sync process

--- PASS: TestFunctional/parallel/FileSync (0.59s)

–

TestFunctional/parallel/CertSync (2.4s)

=== RUN   TestFunctional/parallel/CertSync

=== PAUSE TestFunctional/parallel/CertSync

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1802: Checking for existence of /etc/ssl/certs/532170.pem within VM

functional_test.go:1803: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /etc/ssl/certs/532170.pem"

functional_test.go:1802: Checking for existence of /usr/share/ca-certificates/532170.pem within VM

functional_test.go:1803: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /usr/share/ca-certificates/532170.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1802: Checking for existence of /etc/ssl/certs/51391683.0 within VM

functional_test.go:1803: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /etc/ssl/certs/51391683.0"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1829: Checking for existence of /etc/ssl/certs/5321702.pem within VM

functional_test.go:1830: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /etc/ssl/certs/5321702.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1829: Checking for existence of /usr/share/ca-certificates/5321702.pem within VM

functional_test.go:1830: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /usr/share/ca-certificates/5321702.pem"

functional_test.go:1829: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM

functional_test.go:1830: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"

2021/12/03 02:18:28 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/

--- PASS: TestFunctional/parallel/CertSync (2.40s)

–

TestFunctional/parallel/NodeLabels (0.07s)

=== RUN   TestFunctional/parallel/NodeLabels

=== PAUSE TestFunctional/parallel/NodeLabels

=== CONT  TestFunctional/parallel/NodeLabels

functional_test.go:214: (dbg) Run:  kubectl --context functional-20211203021548-532170 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"

--- PASS: TestFunctional/parallel/NodeLabels (0.07s)

–

TestFunctional/parallel/NonActiveRuntimeDisabled (0.88s)

=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled

=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

functional_test.go:1857: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo systemctl is-active docker"

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

functional_test.go:1857: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo systemctl is-active docker": exit status 1 (428.660925ms)

-- stdout --

	inactive

-- /stdout --

** stderr **

	ssh: Process exited with status 3

** /stderr **

functional_test.go:1857: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo systemctl is-active crio"

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

functional_test.go:1857: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo systemctl is-active crio": exit status 1 (447.924813ms)

-- stdout --

	inactive

-- /stdout --

** stderr **

	ssh: Process exited with status 3

** /stderr **

--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.88s)

–

TestFunctional/parallel/ProfileCmd/profile_not_create (0.59s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create

functional_test.go:1250: (dbg) Run:  out/minikube-linux-amd64 profile lis

=== CONT  TestFunctional/parallel/ProfileCmd/profile_not_create

functional_test.go:1255: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.59s)

–

TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel

functional_test_tunnel_test.go:127: (dbg) daemon: [out/minikube-linux-amd64 -p functional-20211203021548-532170 tunnel --alsologtostderr]

--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.27s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:147: (dbg) Run:  kubectl --context functional-20211203021548-532170 apply -f testdata/testsvc.yaml

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...

helpers_test.go:343: "nginx-svc" [0ba310b3-cf71-46f9-97cf-bf46938dfe28] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

helpers_test.go:343: "nginx-svc" [0ba310b3-cf71-46f9-97cf-bf46938dfe28] Running

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.014990896s

--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.27s)

–

TestFunctional/parallel/ProfileCmd/profile_list (0.54s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_list

functional_test.go:1290: (dbg) Run:  out/minikube-linux-amd64 profile list

=== CONT  TestFunctional/parallel/ProfileCmd/profile_list

functional_test.go:1295: Took "467.426746ms" to run "out/minikube-linux-amd64 profile list"

functional_test.go:1304: (dbg) Run:  out/minikube-linux-amd64 profile list -l

=== CONT  TestFunctional/parallel/ProfileCmd/profile_list

functional_test.go:1309: Took "77.32556ms" to run "out/minikube-linux-amd64 profile list -l"

--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.54s)

–

TestFunctional/parallel/ProfileCmd/profile_json_output (0.45s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output

functional_test.go:1341: (dbg) Run:  out/minikube-linux-amd64 profile list -o json

=== CONT  TestFunctional/parallel/ProfileCmd/profile_json_output

functional_test.go:1346: Took "389.926707ms" to run "out/minikube-linux-amd64 profile list -o json"

functional_test.go:1354: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light

functional_test.go:1359: Took "62.045ms" to run "out/minikube-linux-amd64 profile list -o json --light"

--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.45s)

–

TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes

functional_test.go:1949: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 update-context --alsologtostderr -v=2

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

–

TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.2s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

functional_test.go:1949: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 update-context --alsologtostderr -v=2

E1203 02:18:29.689487  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.20s)

–

TestFunctional/parallel/UpdateContextCmd/no_clusters (0.21s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters

functional_test.go:1949: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 update-context --alsologtostderr -v=2

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.21s)

–

TestFunctional/parallel/ImageCommands/ImageList (0.25s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageList

=== PAUSE TestFunctional/parallel/ImageCommands/ImageList

=== CONT  TestFunctional/parallel/ImageCommands/ImageList

functional_test.go:263: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

=== CONT  TestFunctional/parallel/ImageCommands/ImageList

functional_test.go:268: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls:

k8s.gcr.io/pause:latest

k8s.gcr.io/pause:3.5

k8s.gcr.io/pause:3.3

k8s.gcr.io/pause:3.1

k8s.gcr.io/kube-scheduler:v1.22.4

k8s.gcr.io/kube-proxy:v1.22.4

k8s.gcr.io/kube-controller-manager:v1.22.4

k8s.gcr.io/kube-apiserver:v1.22.4

k8s.gcr.io/etcd:3.5.0-0

k8s.gcr.io/echoserver:1.8

k8s.gcr.io/coredns/coredns:v1.8.4

gcr.io/k8s-minikube/storage-provisioner:v5

gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

docker.io/library/nginx:latest

docker.io/library/nginx:alpine

docker.io/library/minikube-local-cache-test:functional-20211203021548-532170

docker.io/library/busybox:1.28.4-glibc

docker.io/kubernetesui/metrics-scraper:v1.0.7

docker.io/kubernetesui/dashboard:v2.3.1

docker.io/kindest/kindnetd:v20210326-1e038dc5

--- PASS: TestFunctional/parallel/ImageCommands/ImageList (0.25s)

–

TestFunctional/parallel/ImageCommands/ImageBuild (4.18s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild

=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild

functional_test.go:286: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh pgrep buildkitd

=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild

functional_test.go:286: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh pgrep buildkitd: exit status 1 (357.690184ms)

** stderr **

	ssh: Process exited with status 1

** /stderr **

functional_test.go:293: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image build -t localhost/my-image:functional-20211203021548-532170 testdata/build

functional_test.go:293: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image build -t localhost/my-image:functional-20211203021548-532170 testdata/build: (3.524604658s)

functional_test.go:301: (dbg) Stderr: out/minikube-linux-amd64 -p functional-20211203021548-532170 image build -t localhost/my-image:functional-20211203021548-532170 testdata/build:

#1 [internal] load build definition from Dockerfile

#1 transferring dockerfile: 77B done

#1 DONE 0.0s

#2 [internal] load .dockerignore

#2 transferring context: 2B done

#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/busybox:latest

#3 DONE 1.9s

#5 [internal] load build context

#5 transferring context: 62B done

#5 DONE 0.0s

#7 [1/3] FROM docker.io/library/busybox@sha256:52817dece4cfe26f581c834d27a8e1bcc82194f914afe6d50afad5a101234ef1

#7 resolve docker.io/library/busybox@sha256:52817dece4cfe26f581c834d27a8e1bcc82194f914afe6d50afad5a101234ef1 0.0s done

#7 extracting sha256:3aab638df1a9e5bd507442990a0fa8f97c2c48870922f44675c22d0b9060cf66

#7 extracting sha256:3aab638df1a9e5bd507442990a0fa8f97c2c48870922f44675c22d0b9060cf66 0.1s done

#7 DONE 0.3s

#4 [2/3] RUN true

#4 DONE 0.4s

#6 [3/3] ADD content.txt /

#6 DONE 0.1s

#8 exporting to image

#8 exporting layers

#8 exporting layers 0.1s done

#8 exporting manifest sha256:0382809d54422380187c60339862cb323f115172a93b04a6a9af4303b2a15dae done

#8 exporting config sha256:0a93afd6b352028c5bd33291f2d915c0484d3c1011b88af75e0ccee9b505abd6 0.0s done

#8 naming to localhost/my-image:functional-20211203021548-532170 done

#8 DONE 0.2s

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.18s)

–

TestFunctional/parallel/ImageCommands/Setup (1.02s)

=== RUN   TestFunctional/parallel/ImageCommands/Setup

functional_test.go:320: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8

functional_test.go:325: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.02s)

–

TestFunctional/parallel/ImageCommands/ImageLoadDaemon (5.09s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon

functional_test.go:333: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

=== CONT  TestFunctional/parallel/ImageCommands/ImageLoadDaemon

functional_test.go:333: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170: (4.845404566s)

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (5.09s)

–

TestFunctional/parallel/ImageCommands/ImageReloadDaemon (4.95s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon

functional_test.go:343: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

=== CONT  TestFunctional/parallel/ImageCommands/ImageReloadDaemon

functional_test.go:343: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170: (4.664777832s)

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (4.95s)

–

TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20211203021548-532170 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.06s)

–

TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect

functional_test_tunnel_test.go:234: tunnel at http://10.102.11.89 is working!

--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel

functional_test_tunnel_test.go:369: (dbg) stopping [out/minikube-linux-amd64 -p functional-20211203021548-532170 tunnel --alsologtostderr] ...

--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

–

TestFunctional/parallel/Version/short (0.06s)

=== RUN   TestFunctional/parallel/Version/short

=== PAUSE TestFunctional/parallel/Version/short

=== CONT  TestFunctional/parallel/Version/short

functional_test.go:2089: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 version --short

--- PASS: TestFunctional/parallel/Version/short (0.06s)

–

TestFunctional/parallel/Version/components (0.57s)

=== RUN   TestFunctional/parallel/Version/components

=== PAUSE TestFunctional/parallel/Version/components

=== CONT  TestFunctional/parallel/Version/components

functional_test.go:2103: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 version -o=json --components

--- PASS: TestFunctional/parallel/Version/components (0.57s)

–

TestFunctional/parallel/MountCmd/any-port (8.16s)

=== RUN   TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:76: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20211203021548-532170 /tmp/mounttest3789512927:/mount-9p --alsologtostderr -v=1]

functional_test_mount_test.go:110: wrote "test-1638497895716259924" to /tmp/mounttest3789512927/created-by-test

functional_test_mount_test.go:110: wrote "test-1638497895716259924" to /tmp/mounttest3789512927/created-by-test-removed-by-pod

functional_test_mount_test.go:110: wrote "test-1638497895716259924" to /tmp/mounttest3789512927/test-1638497895716259924

functional_test_mount_test.go:118: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:118: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (486.774503ms)

** stderr **

	ssh: Process exited with status 1

** /stderr **

functional_test_mount_test.go:118: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:132: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh -- ls -la /mount-9p

functional_test_mount_test.go:136: guest mount directory contents

total 2

-rw-r--r-- 1 docker docker 24 Dec  3 02:18 created-by-test

-rw-r--r-- 1 docker docker 24 Dec  3 02:18 created-by-test-removed-by-pod

-rw-r--r-- 1 docker docker 24 Dec  3 02:18 test-1638497895716259924

functional_test_mount_test.go:140: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh cat /mount-9p/test-1638497895716259924

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:151: (dbg) Run:  kubectl --context functional-20211203021548-532170 replace --force -f testdata/busybox-mount-test.yaml

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:156: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...

helpers_test.go:343: "busybox-mount" [896aa6ee-4c23-4fa9-8df5-d5f16e03baaa] Pending

=== CONT  TestFunctional/parallel/MountCmd/any-port

helpers_test.go:343: "busybox-mount" [896aa6ee-4c23-4fa9-8df5-d5f16e03baaa] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])

=== CONT  TestFunctional/parallel/MountCmd/any-port

helpers_test.go:343: "busybox-mount" [896aa6ee-4c23-4fa9-8df5-d5f16e03baaa] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

functional_test_mount_test.go:156: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.007062771s

functional_test_mount_test.go:172: (dbg) Run:  kubectl --context functional-20211203021548-532170 logs busybox-mount

functional_test_mount_test.go:184: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh stat /mount-9p/created-by-test

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:184: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh stat /mount-9p/created-by-pod

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:93: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo umount -f /mount-9p"

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:97: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20211203021548-532170 /tmp/mounttest3789512927:/mount-9p --alsologtostderr -v=1] ...

--- PASS: TestFunctional/parallel/MountCmd/any-port (8.16s)

–

TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (4.57s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon

functional_test.go:230: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9

=== CONT  TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon

functional_test.go:235: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

functional_test.go:240: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

=== CONT  TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon

functional_test.go:240: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image load --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170: (3.763871637s)

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (4.57s)

–

TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.09s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile

functional_test.go:358: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image save gcr.io/google-containers/addon-resizer:functional-20211203021548-532170 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar

=== CONT  TestFunctional/parallel/ImageCommands/ImageSaveToFile

functional_test.go:358: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image save gcr.io/google-containers/addon-resizer:functional-20211203021548-532170 /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar: (1.089581904s)

--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.09s)

–

TestFunctional/parallel/ImageCommands/ImageRemove (0.6s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove

functional_test.go:370: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image rm gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

=== CONT  TestFunctional/parallel/ImageCommands/ImageRemove

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.60s)

–

TestFunctional/parallel/MountCmd/specific-port (2.33s)

=== RUN   TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:225: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20211203021548-532170 /tmp/mounttest2717240986:/mount-9p --alsologtostderr -v=1 --port 46464]

functional_test_mount_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p"

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:255: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (417.135516ms)

** stderr **

	ssh: Process exited with status 1

** /stderr **

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "findmnt -T /mount-9p | grep 9p"

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:269: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh -- ls -la /mount-9p

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:273: guest mount directory contents

total 0

functional_test_mount_test.go:275: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20211203021548-532170 /tmp/mounttest2717240986:/mount-9p --alsologtostderr -v=1 --port 46464] ...

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:276: reading mount text

functional_test_mount_test.go:290: done reading mount text

functional_test_mount_test.go:242: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo umount -f /mount-9p"

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:242: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh "sudo umount -f /mount-9p": exit status 1 (494.102765ms)

-- stdout --

	umount: /mount-9p: not mounted.

-- /stdout --

** stderr **

	ssh: Process exited with status 32

** /stderr **

functional_test_mount_test.go:244: "out/minikube-linux-amd64 -p functional-20211203021548-532170 ssh \"sudo umount -f /mount-9p\"": exit status 1

functional_test_mount_test.go:246: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20211203021548-532170 /tmp/mounttest2717240986:/mount-9p --alsologtostderr -v=1 --port 46464] ...

--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.33s)

–

TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.41s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile

functional_test.go:387: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar

=== CONT  TestFunctional/parallel/ImageCommands/ImageLoadFromFile

functional_test.go:387: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/addon-resizer-save.tar: (1.142643961s)

functional_test.go:426: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image ls

--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.41s)

–

TestFunctional/parallel/ImageCommands/ImageSaveDaemon (2.14s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon

functional_test.go:397: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

functional_test.go:402: (dbg) Run:  out/minikube-linux-amd64 -p functional-20211203021548-532170 image save --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

=== CONT  TestFunctional/parallel/ImageCommands/ImageSaveDaemon

functional_test.go:402: (dbg) Done: out/minikube-linux-amd64 -p functional-20211203021548-532170 image save --daemon gcr.io/google-containers/addon-resizer:functional-20211203021548-532170: (2.03684994s)

functional_test.go:407: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (2.14s)

–

TestFunctional/delete_addon-resizer_images (0.09s)

=== RUN   TestFunctional/delete_addon-resizer_images

functional_test.go:185: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8

functional_test.go:185: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-20211203021548-532170

--- PASS: TestFunctional/delete_addon-resizer_images (0.09s)

–

TestFunctional/delete_my-image_image (0.04s)

=== RUN   TestFunctional/delete_my-image_image

functional_test.go:193: (dbg) Run:  docker rmi -f localhost/my-image:functional-20211203021548-532170

--- PASS: TestFunctional/delete_my-image_image (0.04s)

–

TestFunctional/delete_minikube_cached_images (0.04s)

=== RUN   TestFunctional/delete_minikube_cached_images

functional_test.go:201: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-20211203021548-532170

--- PASS: TestFunctional/delete_minikube_cached_images (0.04s)

–

TestIngressAddonLegacy/StartLegacyK8sCluster (89.83s)

=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster

ingress_addon_legacy_test.go:40: (dbg) Run:  out/minikube-linux-amd64 start -p ingress-addon-legacy-20211203021853-532170 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

E1203 02:19:51.610511  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

ingress_addon_legacy_test.go:40: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-20211203021853-532170 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (1m29.831223916s)

--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (89.83s)

–

TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (13.69s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation

ingress_addon_legacy_test.go:71: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons enable ingress --alsologtostderr -v=5

ingress_addon_legacy_test.go:71: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons enable ingress --alsologtostderr -v=5: (13.693247993s)

--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (13.69s)

–

TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.38s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation

ingress_addon_legacy_test.go:80: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons enable ingress-dns --alsologtostderr -v=5

--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.38s)

–

TestIngressAddonLegacy/serial/ValidateIngressAddons (49.92s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons

addons_test.go:163: (dbg) Run:  kubectl --context ingress-addon-legacy-20211203021853-532170 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:163: (dbg) Done: kubectl --context ingress-addon-legacy-20211203021853-532170 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (9.039742126s)

addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-20211203021853-532170 replace --force -f testdata/nginx-ingress-v1beta1.yaml

addons_test.go:196: (dbg) Run:  kubectl --context ingress-addon-legacy-20211203021853-532170 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:201: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:343: "nginx" [f2dc3ad7-26a0-45a9-94f6-dae7e3a5399c] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:343: "nginx" [f2dc3ad7-26a0-45a9-94f6-dae7e3a5399c] Running

addons_test.go:201: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 9.007388996s

addons_test.go:213: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:237: (dbg) Run:  kubectl --context ingress-addon-legacy-20211203021853-532170 replace --force -f testdata/ingress-dns-example-v1beta1.yaml

addons_test.go:242: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 ip

addons_test.go:248: (dbg) Run:  nslookup hello-john.test 192.168.49.2

addons_test.go:257: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:257: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons disable ingress-dns --alsologtostderr -v=1: (2.035048924s)

addons_test.go:262: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons disable ingress --alsologtostderr -v=1

addons_test.go:262: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-20211203021853-532170 addons disable ingress --alsologtostderr -v=1: (28.457867828s)

--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddons (49.92s)

–

TestJSONOutput/start/Command (55.32s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-20211203022131-532170 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd

E1203 02:22:07.765699  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-20211203022131-532170 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (55.314701509s)

--- PASS: TestJSONOutput/start/Command (55.32s)

–

TestJSONOutput/start/Audit (0s)

=== RUN   TestJSONOutput/start/Audit

--- PASS: TestJSONOutput/start/Audit (0.00s)

–

TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/pause/Command (0.66s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-20211203022131-532170 --output=json --user=testUser

--- PASS: TestJSONOutput/pause/Command (0.66s)

–

TestJSONOutput/pause/Audit (0s)

=== RUN   TestJSONOutput/pause/Audit

--- PASS: TestJSONOutput/pause/Audit (0.00s)

–

TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/unpause/Command (0.64s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-20211203022131-532170 --output=json --user=testUser

--- PASS: TestJSONOutput/unpause/Command (0.64s)

–

TestJSONOutput/unpause/Audit (0s)

=== RUN   TestJSONOutput/unpause/Audit

--- PASS: TestJSONOutput/unpause/Audit (0.00s)

–

TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/stop/Command (24.41s)

=== RUN   TestJSONOutput/stop/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-20211203022131-532170 --output=json --user=testUser

E1203 02:22:35.451385  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-20211203022131-532170 --output=json --user=testUser: (24.410767846s)

--- PASS: TestJSONOutput/stop/Command (24.41s)

–

TestJSONOutput/stop/Audit (0s)

=== RUN   TestJSONOutput/stop/Audit

--- PASS: TestJSONOutput/stop/Audit (0.00s)

–

TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

–

TestErrorJSONOutput (0.34s)

=== RUN   TestErrorJSONOutput

json_output_test.go:149: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-20211203022257-532170 --memory=2200 --output=json --wait=true --driver=fail

json_output_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-20211203022257-532170 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (93.30326ms)

-- stdout --

	{"specversion":"1.0","id":"09b3b22e-6c4f-4066-bb5a-ab59c00989dd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-20211203022257-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"f9f956ac-ae9b-4283-ae04-434c043ac6e9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig"}}

	{"specversion":"1.0","id":"00b19ced-85e3-48de-b770-1b36d5149d24","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}

	{"specversion":"1.0","id":"d3a55de1-4633-4bbd-8635-70725e3193a9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube"}}

	{"specversion":"1.0","id":"4f9cc2a3-9453-404b-83a8-9a2fc8205d10","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12084"}}

	{"specversion":"1.0","id":"6dcda628-b552-43af-8326-41e49d1f7df4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

-- /stdout --

helpers_test.go:176: Cleaning up "json-output-error-20211203022257-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-20211203022257-532170

--- PASS: TestErrorJSONOutput (0.34s)

–

TestKicCustomNetwork/create_custom_network (27.5s)

=== RUN   TestKicCustomNetwork/create_custom_network

kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20211203022257-532170 --network=

E1203 02:23:05.912625  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:05.917948  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:05.928211  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:05.948526  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:05.988843  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:06.069191  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:06.229608  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:06.550160  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:07.191075  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:08.471939  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:11.033126  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:16.153904  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20211203022257-532170 --network=: (24.887117627s)

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

helpers_test.go:176: Cleaning up "docker-network-20211203022257-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20211203022257-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20211203022257-532170: (2.56807958s)

--- PASS: TestKicCustomNetwork/create_custom_network (27.50s)

–

TestKicCustomNetwork/use_default_bridge_network (24.95s)

=== RUN   TestKicCustomNetwork/use_default_bridge_network

kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20211203022325-532170 --network=bridge

E1203 02:23:26.394110  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:23:46.875238  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20211203022325-532170 --network=bridge: (22.558259417s)

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

helpers_test.go:176: Cleaning up "docker-network-20211203022325-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20211203022325-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20211203022325-532170: (2.34778895s)

--- PASS: TestKicCustomNetwork/use_default_bridge_network (24.95s)

–

TestKicExistingNetwork (24.59s)

=== RUN   TestKicExistingNetwork

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

kic_custom_network_test.go:94: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-20211203022350-532170 --network=existing-network

kic_custom_network_test.go:94: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-20211203022350-532170 --network=existing-network: (21.787017139s)

helpers_test.go:176: Cleaning up "existing-network-20211203022350-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-20211203022350-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-20211203022350-532170: (2.542267844s)

--- PASS: TestKicExistingNetwork (24.59s)

–

TestMainNoArgs (0.06s)

=== RUN   TestMainNoArgs

main_test.go:68: (dbg) Run:  out/minikube-linux-amd64

--- PASS: TestMainNoArgs (0.06s)

–

TestMountStart/serial/StartWithMountFirst (24.8s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:77: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-1-20211203022415-532170 --memory=2048 --mount --driver=docker  --container-runtime=containerd

E1203 02:24:27.835958  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

mount_start_test.go:77: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-20211203022415-532170 --memory=2048 --mount --driver=docker  --container-runtime=containerd: (24.802171264s)

--- PASS: TestMountStart/serial/StartWithMountFirst (24.80s)

–

TestMountStart/serial/StartWithMountSecond (40.46s)

=== RUN   TestMountStart/serial/StartWithMountSecond

mount_start_test.go:77: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-20211203022415-532170 --memory=2048 --mount --driver=docker  --container-runtime=containerd

mount_start_test.go:77: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-20211203022415-532170 --memory=2048 --mount --driver=docker  --container-runtime=containerd: (40.455139444s)

--- PASS: TestMountStart/serial/StartWithMountSecond (40.46s)

–

TestMountStart/serial/VerifyMountFirst (0.34s)

=== RUN   TestMountStart/serial/VerifyMountFirst

mount_start_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-1-20211203022415-532170 ssh ls /minikube-host

--- PASS: TestMountStart/serial/VerifyMountFirst (0.34s)

–

TestMountStart/serial/VerifyMountSecond (0.34s)

=== RUN   TestMountStart/serial/VerifyMountSecond

mount_start_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20211203022415-532170 ssh ls /minikube-host

--- PASS: TestMountStart/serial/VerifyMountSecond (0.34s)

–

TestMountStart/serial/DeleteFirst (2.97s)

=== RUN   TestMountStart/serial/DeleteFirst

pause_test.go:130: (dbg) Run:  out/minikube-linux-amd64 delete -p mount-start-1-20211203022415-532170 --alsologtostderr -v=5

pause_test.go:130: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-20211203022415-532170 --alsologtostderr -v=5: (2.973259823s)

--- PASS: TestMountStart/serial/DeleteFirst (2.97s)

–

TestMountStart/serial/VerifyMountPostDelete (0.35s)

=== RUN   TestMountStart/serial/VerifyMountPostDelete

mount_start_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20211203022415-532170 ssh ls /minikube-host

--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.35s)

–

TestMountStart/serial/Stop (20.48s)

=== RUN   TestMountStart/serial/Stop

mount_start_test.go:99: (dbg) Run:  out/minikube-linux-amd64 stop -p mount-start-2-20211203022415-532170

E1203 02:25:37.892569  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:37.897850  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:37.908134  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:37.928441  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:37.968810  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:38.049152  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:38.209612  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:38.530174  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:39.171065  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:40.451549  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:43.012425  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

mount_start_test.go:99: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-20211203022415-532170: (20.475651069s)

--- PASS: TestMountStart/serial/Stop (20.48s)

–

TestMountStart/serial/RestartStopped (33.56s)

=== RUN   TestMountStart/serial/RestartStopped

mount_start_test.go:110: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-20211203022415-532170

E1203 02:25:48.132763  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:25:49.756567  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

E1203 02:25:58.373146  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

mount_start_test.go:110: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-20211203022415-532170: (33.559278709s)

--- PASS: TestMountStart/serial/RestartStopped (33.56s)

–

TestMountStart/serial/VerifyMountPostStop (0.35s)

=== RUN   TestMountStart/serial/VerifyMountPostStop

mount_start_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-20211203022415-532170 ssh ls /minikube-host

--- PASS: TestMountStart/serial/VerifyMountPostStop (0.35s)

–

TestMultiNode/serial/FreshStart2Nodes (107.34s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:85: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd

E1203 02:26:59.814758  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:27:07.765810  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:28:05.912023  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

multinode_test.go:85: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m46.728617998s)

multinode_test.go:91: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

--- PASS: TestMultiNode/serial/FreshStart2Nodes (107.34s)

–

TestMultiNode/serial/DeployApp2Nodes (5.57s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:485: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:490: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- rollout status deployment/busybox

multinode_test.go:490: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- rollout status deployment/busybox: (3.732851815s)

multinode_test.go:496: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:508: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:516: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-2v29f -- nslookup kubernetes.io

multinode_test.go:516: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-7tvxj -- nslookup kubernetes.io

multinode_test.go:526: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-2v29f -- nslookup kubernetes.default

multinode_test.go:526: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-7tvxj -- nslookup kubernetes.default

multinode_test.go:534: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-2v29f -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:534: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-7tvxj -- nslookup kubernetes.default.svc.cluster.local

--- PASS: TestMultiNode/serial/DeployApp2Nodes (5.57s)

–

TestMultiNode/serial/PingHostFrom2Pods (0.87s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:544: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:552: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-2v29f -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"

multinode_test.go:560: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-2v29f -- sh -c "ping -c 1 192.168.49.1"

multinode_test.go:552: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-7tvxj -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"

multinode_test.go:560: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20211203022621-532170 -- exec busybox-84b6686758-7tvxj -- sh -c "ping -c 1 192.168.49.1"

--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.87s)

–

TestMultiNode/serial/AddNode (41.49s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:110: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20211203022621-532170 -v 3 --alsologtostderr

E1203 02:28:21.735080  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:28:33.597582  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

multinode_test.go:110: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-20211203022621-532170 -v 3 --alsologtostderr: (40.670068652s)

multinode_test.go:116: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

--- PASS: TestMultiNode/serial/AddNode (41.49s)

–

TestMultiNode/serial/ProfileList (0.37s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:132: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

--- PASS: TestMultiNode/serial/ProfileList (0.37s)

–

TestMultiNode/serial/CopyFile (12.35s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:173: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --output json --alsologtostderr

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp testdata/cp-test.txt multinode-20211203022621-532170:/home/docker/cp-test.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170:/home/docker/cp-test.txt /tmp/mk_cp_test1891050748/cp-test_multinode-20211203022621-532170.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170:/home/docker/cp-test.txt multinode-20211203022621-532170-m02:/home/docker/cp-test_multinode-20211203022621-532170_multinode-20211203022621-532170-m02.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170_multinode-20211203022621-532170-m02.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170:/home/docker/cp-test.txt multinode-20211203022621-532170-m03:/home/docker/cp-test_multinode-20211203022621-532170_multinode-20211203022621-532170-m03.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170_multinode-20211203022621-532170-m03.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp testdata/cp-test.txt multinode-20211203022621-532170-m02:/home/docker/cp-test.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m02:/home/docker/cp-test.txt /tmp/mk_cp_test1891050748/cp-test_multinode-20211203022621-532170-m02.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m02:/home/docker/cp-test.txt multinode-20211203022621-532170:/home/docker/cp-test_multinode-20211203022621-532170-m02_multinode-20211203022621-532170.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170-m02_multinode-20211203022621-532170.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m02:/home/docker/cp-test.txt multinode-20211203022621-532170-m03:/home/docker/cp-test_multinode-20211203022621-532170-m02_multinode-20211203022621-532170-m03.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170-m02_multinode-20211203022621-532170-m03.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp testdata/cp-test.txt multinode-20211203022621-532170-m03:/home/docker/cp-test.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m03:/home/docker/cp-test.txt /tmp/mk_cp_test1891050748/cp-test_multinode-20211203022621-532170-m03.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m03:/home/docker/cp-test.txt multinode-20211203022621-532170:/home/docker/cp-test_multinode-20211203022621-532170-m03_multinode-20211203022621-532170.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170-m03_multinode-20211203022621-532170.txt"

helpers_test.go:555: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 cp multinode-20211203022621-532170-m03:/home/docker/cp-test.txt multinode-20211203022621-532170-m02:/home/docker/cp-test_multinode-20211203022621-532170-m03_multinode-20211203022621-532170-m02.txt

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m03 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 ssh -n multinode-20211203022621-532170-m02 "sudo cat /home/docker/cp-test_multinode-20211203022621-532170-m03_multinode-20211203022621-532170-m02.txt"

--- PASS: TestMultiNode/serial/CopyFile (12.35s)

–

TestMultiNode/serial/StopNode (22.03s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:214: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 node stop m03

multinode_test.go:214: (dbg) Done: out/minikube-linux-amd64 -p multinode-20211203022621-532170 node stop m03: (20.750641656s)

multinode_test.go:220: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status

multinode_test.go:220: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20211203022621-532170 status: exit status 7 (642.362405ms)

-- stdout --

	multinode-20211203022621-532170

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	multinode-20211203022621-532170-m02

	type: Worker

	host: Running

	kubelet: Running

	multinode-20211203022621-532170-m03

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

multinode_test.go:227: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

multinode_test.go:227: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr: exit status 7 (637.666029ms)

-- stdout --

	multinode-20211203022621-532170

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	multinode-20211203022621-532170-m02

	type: Worker

	host: Running

	kubelet: Running

	multinode-20211203022621-532170-m03

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr **

	I1203 02:29:31.094014  617230 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:29:31.094109  617230 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:29:31.094117  617230 out.go:310] Setting ErrFile to fd 2...

	I1203 02:29:31.094121  617230 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:29:31.094228  617230 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:29:31.094385  617230 out.go:304] Setting JSON to false

	I1203 02:29:31.094407  617230 mustload.go:65] Loading cluster: multinode-20211203022621-532170

	I1203 02:29:31.094752  617230 config.go:176] Loaded profile config "multinode-20211203022621-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:29:31.094768  617230 status.go:253] checking status of multinode-20211203022621-532170 ...

	I1203 02:29:31.095116  617230 cli_runner.go:115] Run: docker container inspect multinode-20211203022621-532170 --format={{.State.Status}}

	I1203 02:29:31.134433  617230 status.go:328] multinode-20211203022621-532170 host status = "Running" (err=<nil>)

	I1203 02:29:31.134461  617230 host.go:66] Checking if "multinode-20211203022621-532170" exists ...

	I1203 02:29:31.134752  617230 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20211203022621-532170

	I1203 02:29:31.174935  617230 host.go:66] Checking if "multinode-20211203022621-532170" exists ...

	I1203 02:29:31.175275  617230 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1203 02:29:31.175358  617230 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20211203022621-532170

	I1203 02:29:31.214760  617230 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33221 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/multinode-20211203022621-532170/id_rsa Username:docker}

	I1203 02:29:31.297620  617230 ssh_runner.go:195] Run: systemctl --version

	I1203 02:29:31.301271  617230 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:29:31.309774  617230 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:29:31.391308  617230 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:45 SystemTime:2021-12-03 02:29:31.346385577 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:29:31.392117  617230 kubeconfig.go:92] found "multinode-20211203022621-532170" server: "https://192.168.49.2:8443"

	I1203 02:29:31.392143  617230 api_server.go:165] Checking apiserver status ...

	I1203 02:29:31.392172  617230 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1203 02:29:31.410049  617230 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1137/cgroup

	I1203 02:29:31.417347  617230 api_server.go:181] apiserver freezer: "7:freezer:/docker/f2e846c038ea431eaa225ea34b904b637ce86fc809341423cc0db605bec65d8b/kubepods/burstable/podd0267cbc4953d7c4f690036215945f5c/bdc56d908790eab7884d9ca783375a5392b4bb8ff12a7e6bdac485835bd9417b"

	I1203 02:29:31.417398  617230 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/f2e846c038ea431eaa225ea34b904b637ce86fc809341423cc0db605bec65d8b/kubepods/burstable/podd0267cbc4953d7c4f690036215945f5c/bdc56d908790eab7884d9ca783375a5392b4bb8ff12a7e6bdac485835bd9417b/freezer.state

	I1203 02:29:31.423503  617230 api_server.go:203] freezer state: "THAWED"

	I1203 02:29:31.423528  617230 api_server.go:240] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I1203 02:29:31.428636  617230 api_server.go:266] https://192.168.49.2:8443/healthz returned 200:

ok

	I1203 02:29:31.428671  617230 status.go:419] multinode-20211203022621-532170 apiserver status = Running (err=<nil>)

	I1203 02:29:31.428683  617230 status.go:255] multinode-20211203022621-532170 status: &{Name:multinode-20211203022621-532170 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I1203 02:29:31.428715  617230 status.go:253] checking status of multinode-20211203022621-532170-m02 ...

	I1203 02:29:31.429222  617230 cli_runner.go:115] Run: docker container inspect multinode-20211203022621-532170-m02 --format={{.State.Status}}

	I1203 02:29:31.468309  617230 status.go:328] multinode-20211203022621-532170-m02 host status = "Running" (err=<nil>)

	I1203 02:29:31.468336  617230 host.go:66] Checking if "multinode-20211203022621-532170-m02" exists ...

	I1203 02:29:31.468625  617230 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20211203022621-532170-m02

	I1203 02:29:31.508757  617230 host.go:66] Checking if "multinode-20211203022621-532170-m02" exists ...

	I1203 02:29:31.509030  617230 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1203 02:29:31.509078  617230 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20211203022621-532170-m02

	I1203 02:29:31.549691  617230 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33226 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/machines/multinode-20211203022621-532170-m02/id_rsa Username:docker}

	I1203 02:29:31.628826  617230 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1203 02:29:31.637880  617230 status.go:255] multinode-20211203022621-532170-m02 status: &{Name:multinode-20211203022621-532170-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	I1203 02:29:31.637915  617230 status.go:253] checking status of multinode-20211203022621-532170-m03 ...

	I1203 02:29:31.638150  617230 cli_runner.go:115] Run: docker container inspect multinode-20211203022621-532170-m03 --format={{.State.Status}}

	I1203 02:29:31.677693  617230 status.go:328] multinode-20211203022621-532170-m03 host status = "Stopped" (err=<nil>)

	I1203 02:29:31.677723  617230 status.go:341] host is not running, skipping remaining checks

	I1203 02:29:31.677730  617230 status.go:255] multinode-20211203022621-532170-m03 status: &{Name:multinode-20211203022621-532170-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

--- PASS: TestMultiNode/serial/StopNode (22.03s)

–

TestMultiNode/serial/StartAfterStop (35.5s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:248: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:258: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 node start m03 --alsologtostderr

multinode_test.go:258: (dbg) Done: out/minikube-linux-amd64 -p multinode-20211203022621-532170 node start m03 --alsologtostderr: (34.560744268s)

multinode_test.go:265: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status

multinode_test.go:279: (dbg) Run:  kubectl get nodes

--- PASS: TestMultiNode/serial/StartAfterStop (35.50s)

–

TestMultiNode/serial/RestartKeepsNodes (190.96s)

=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:287: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20211203022621-532170

multinode_test.go:294: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-20211203022621-532170

E1203 02:30:37.891908  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:31:05.578257  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

multinode_test.go:294: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-20211203022621-532170: (1m1.658036509s)

multinode_test.go:299: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true -v=8 --alsologtostderr

E1203 02:32:07.765509  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:33:05.911995  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

multinode_test.go:299: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true -v=8 --alsologtostderr: (2m9.182083637s)

multinode_test.go:304: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20211203022621-532170

--- PASS: TestMultiNode/serial/RestartKeepsNodes (190.96s)

–

TestMultiNode/serial/DeleteNode (25.22s)

=== RUN   TestMultiNode/serial/DeleteNode

multinode_test.go:398: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 node delete m03

E1203 02:33:30.813543  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

multinode_test.go:398: (dbg) Done: out/minikube-linux-amd64 -p multinode-20211203022621-532170 node delete m03: (24.321890212s)

multinode_test.go:404: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

multinode_test.go:418: (dbg) Run:  docker volume ls

multinode_test.go:428: (dbg) Run:  kubectl get nodes

multinode_test.go:436: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"

--- PASS: TestMultiNode/serial/DeleteNode (25.22s)

–

TestMultiNode/serial/StopMultiNode (41.6s)

=== RUN   TestMultiNode/serial/StopMultiNode

multinode_test.go:318: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 stop

multinode_test.go:318: (dbg) Done: out/minikube-linux-amd64 -p multinode-20211203022621-532170 stop: (41.331847553s)

multinode_test.go:324: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status

multinode_test.go:324: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20211203022621-532170 status: exit status 7 (132.361686ms)

-- stdout --

	multinode-20211203022621-532170

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	multinode-20211203022621-532170-m02

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

multinode_test.go:331: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

multinode_test.go:331: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr: exit status 7 (131.667864ms)

-- stdout --

	multinode-20211203022621-532170

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	multinode-20211203022621-532170-m02

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr **

	I1203 02:34:24.867882  628398 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:34:24.867974  628398 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:34:24.868001  628398 out.go:310] Setting ErrFile to fd 2...

	I1203 02:34:24.868005  628398 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:34:24.868099  628398 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:34:24.868258  628398 out.go:304] Setting JSON to false

	I1203 02:34:24.868280  628398 mustload.go:65] Loading cluster: multinode-20211203022621-532170

	I1203 02:34:24.868612  628398 config.go:176] Loaded profile config "multinode-20211203022621-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:34:24.868626  628398 status.go:253] checking status of multinode-20211203022621-532170 ...

	I1203 02:34:24.869023  628398 cli_runner.go:115] Run: docker container inspect multinode-20211203022621-532170 --format={{.State.Status}}

	I1203 02:34:24.907870  628398 status.go:328] multinode-20211203022621-532170 host status = "Stopped" (err=<nil>)

	I1203 02:34:24.907907  628398 status.go:341] host is not running, skipping remaining checks

	I1203 02:34:24.907913  628398 status.go:255] multinode-20211203022621-532170 status: &{Name:multinode-20211203022621-532170 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I1203 02:34:24.907971  628398 status.go:253] checking status of multinode-20211203022621-532170-m02 ...

	I1203 02:34:24.908251  628398 cli_runner.go:115] Run: docker container inspect multinode-20211203022621-532170-m02 --format={{.State.Status}}

	I1203 02:34:24.946986  628398 status.go:328] multinode-20211203022621-532170-m02 host status = "Stopped" (err=<nil>)

	I1203 02:34:24.947019  628398 status.go:341] host is not running, skipping remaining checks

	I1203 02:34:24.947025  628398 status.go:255] multinode-20211203022621-532170-m02 status: &{Name:multinode-20211203022621-532170-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

--- PASS: TestMultiNode/serial/StopMultiNode (41.60s)

–

TestMultiNode/serial/RestartMultiNode (91.93s)

=== RUN   TestMultiNode/serial/RestartMultiNode

multinode_test.go:348: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:358: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd

E1203 02:35:37.892584  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

multinode_test.go:358: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20211203022621-532170 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m31.130652837s)

multinode_test.go:364: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20211203022621-532170 status --alsologtostderr

multinode_test.go:378: (dbg) Run:  kubectl get nodes

multinode_test.go:386: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"

--- PASS: TestMultiNode/serial/RestartMultiNode (91.93s)

–

TestMultiNode/serial/ValidateNameConflict (44s)

=== RUN   TestMultiNode/serial/ValidateNameConflict

multinode_test.go:447: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20211203022621-532170

multinode_test.go:456: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20211203022621-532170-m02 --driver=docker  --container-runtime=containerd

multinode_test.go:456: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20211203022621-532170-m02 --driver=docker  --container-runtime=containerd: exit status 14 (103.442562ms)

-- stdout --

	* [multinode-20211203022621-532170-m02] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

-- /stdout --

** stderr **

	! Profile name 'multinode-20211203022621-532170-m02' is duplicated with machine name 'multinode-20211203022621-532170-m02' in profile 'multinode-20211203022621-532170'

	X Exiting due to MK_USAGE: Profile name should be unique

** /stderr **

multinode_test.go:464: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20211203022621-532170-m03 --driver=docker  --container-runtime=containerd

multinode_test.go:464: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20211203022621-532170-m03 --driver=docker  --container-runtime=containerd: (40.708576276s)

multinode_test.go:471: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20211203022621-532170

multinode_test.go:471: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-20211203022621-532170: exit status 80 (342.17596ms)

-- stdout --

	* Adding node m03 to cluster multinode-20211203022621-532170

-- /stdout --

** stderr **

	X Exiting due to GUEST_NODE_ADD: Node multinode-20211203022621-532170-m03 already exists in multinode-20211203022621-532170-m03 profile

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:476: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-20211203022621-532170-m03

multinode_test.go:476: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-20211203022621-532170-m03: (2.785796374s)

--- PASS: TestMultiNode/serial/ValidateNameConflict (44.00s)

–

TestPreload (145.89s)

=== RUN   TestPreload

preload_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20211203023646-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0

E1203 02:37:07.765248  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:38:05.911746  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

preload_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20211203023646-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.0: (1m36.604120799s)

preload_test.go:62: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20211203023646-532170 -- sudo crictl pull busybox

preload_test.go:62: (dbg) Done: out/minikube-linux-amd64 ssh -p test-preload-20211203023646-532170 -- sudo crictl pull busybox: (2.739784661s)

preload_test.go:72: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20211203023646-532170 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3

preload_test.go:72: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20211203023646-532170 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd --kubernetes-version=v1.17.3: (43.215652175s)

preload_test.go:81: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20211203023646-532170 -- sudo crictl image ls

helpers_test.go:176: Cleaning up "test-preload-20211203023646-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-20211203023646-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-20211203023646-532170: (2.958897396s)

--- PASS: TestPreload (145.89s)

–

TestScheduledStopUnix (118.81s)

=== RUN   TestScheduledStopUnix

scheduled_stop_test.go:129: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-20211203023912-532170 --memory=2048 --driver=docker  --container-runtime=containerd

E1203 02:39:28.958385  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

scheduled_stop_test.go:129: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-20211203023912-532170 --memory=2048 --driver=docker  --container-runtime=containerd: (41.637327878s)

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20211203023912-532170 --schedule 5m

scheduled_stop_test.go:192: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-20211203023912-532170 -n scheduled-stop-20211203023912-532170

scheduled_stop_test.go:170: signal error was:  <nil>

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20211203023912-532170 --schedule 15s

scheduled_stop_test.go:170: signal error was:  os: process already finished

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20211203023912-532170 --cancel-scheduled

scheduled_stop_test.go:177: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20211203023912-532170 -n scheduled-stop-20211203023912-532170

scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20211203023912-532170

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20211203023912-532170 --schedule 15s

scheduled_stop_test.go:170: signal error was:  os: process already finished

E1203 02:40:37.892683  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20211203023912-532170

scheduled_stop_test.go:206: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-20211203023912-532170: exit status 7 (95.538484ms)

-- stdout --

	scheduled-stop-20211203023912-532170

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

scheduled_stop_test.go:177: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20211203023912-532170 -n scheduled-stop-20211203023912-532170

scheduled_stop_test.go:177: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20211203023912-532170 -n scheduled-stop-20211203023912-532170: exit status 7 (95.583473ms)

-- stdout --

	Stopped

-- /stdout --

scheduled_stop_test.go:177: status error: exit status 7 (may be ok)

helpers_test.go:176: Cleaning up "scheduled-stop-20211203023912-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-20211203023912-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-20211203023912-532170: (5.431689495s)

--- PASS: TestScheduledStopUnix (118.81s)

–

TestInsufficientStorage (13.38s)

=== RUN   TestInsufficientStorage

status_test.go:51: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-20211203024110-532170 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd

status_test.go:51: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-20211203024110-532170 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (6.30677882s)

-- stdout --

	{"specversion":"1.0","id":"4d80f78b-4b38-4ee7-8347-2b0ed316aeb2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-20211203024110-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"b4785e8f-cff0-4daa-b98d-f563809e604c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig"}}

	{"specversion":"1.0","id":"70aae903-5ef3-4ed5-8a08-b14ceb033a1c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}

	{"specversion":"1.0","id":"fccc4fa5-8c84-485d-9d83-82e8b1dfe3b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube"}}

	{"specversion":"1.0","id":"fe06125a-d5aa-4e9d-af01-07aa25727f23","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12084"}}

	{"specversion":"1.0","id":"d91f63be-5485-4e77-8a06-90c7f7176b21","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}

	{"specversion":"1.0","id":"132b1c98-746a-4ca6-b5e1-62d15b38d11a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"38c3304c-5845-4abf-b79f-6f755d1e0be0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"Your cgroup does not allow setting memory."}}

	{"specversion":"1.0","id":"7b8be698-2529-4ef9-9d0f-fa5c93196c05","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities"}}

	{"specversion":"1.0","id":"bc669402-dc05-4537-a751-3e49ecff0acd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-20211203024110-532170 in cluster insufficient-storage-20211203024110-532170","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"da500b71-5fdb-4fcf-ac1c-5fb5a495f958","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}

	{"specversion":"1.0","id":"ee585c95-56af-4b8b-8878-655215507def","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}

	{"specversion":"1.0","id":"b54544b9-ffca-429c-96d9-1020b60a8031","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity)","name":"RSRC_DOCKER_STORAGE","url":""}}

-- /stdout --

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20211203024110-532170 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20211203024110-532170 --output=json --layout=cluster: exit status 7 (364.815654ms)

-- stdout --

	{"Name":"insufficient-storage-20211203024110-532170","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.24.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20211203024110-532170","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr **

	E1203 02:41:17.488311  649321 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20211203024110-532170" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

** /stderr **

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20211203024110-532170 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20211203024110-532170 --output=json --layout=cluster: exit status 7 (354.790791ms)

-- stdout --

	{"Name":"insufficient-storage-20211203024110-532170","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.24.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20211203024110-532170","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr **

	E1203 02:41:17.844775  649425 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20211203024110-532170" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	E1203 02:41:17.857079  649425 status.go:557] unable to read event log: stat: stat /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/insufficient-storage-20211203024110-532170/events.json: no such file or directory

** /stderr **

helpers_test.go:176: Cleaning up "insufficient-storage-20211203024110-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-20211203024110-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-20211203024110-532170: (6.355185036s)

--- PASS: TestInsufficientStorage (13.38s)

–

TestRunningBinaryUpgrade (111.23s)

=== RUN   TestRunningBinaryUpgrade

=== PAUSE TestRunningBinaryUpgrade

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Run:  /tmp/minikube-v1.16.0.106241685.exe start -p running-upgrade-20211203024210-532170 --memory=2200 --vm-driver=docker  --container-runtime=containerd

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Done: /tmp/minikube-v1.16.0.106241685.exe start -p running-upgrade-20211203024210-532170 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (40.70005495s)

version_upgrade_test.go:137: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-20211203024210-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-20211203024210-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m6.312465776s)

helpers_test.go:176: Cleaning up "running-upgrade-20211203024210-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-20211203024210-532170

=== CONT  TestRunningBinaryUpgrade

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-20211203024210-532170: (3.638903132s)

--- PASS: TestRunningBinaryUpgrade (111.23s)

–

TestKubernetesUpgrade (249.41s)

=== RUN   TestKubernetesUpgrade

=== PAUSE TestKubernetesUpgrade

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (52.187120902s)

version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-20211203024403-532170

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20211203024403-532170: (21.973899839s)

version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20211203024403-532170 status --format={{.Host}}

version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20211203024403-532170 status --format={{.Host}}: exit status 7 (100.00397ms)

-- stdout --

	Stopped

-- /stdout --

version_upgrade_test.go:241: status error: exit status 7 (may be ok)

version_upgrade_test.go:250: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.23.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

E1203 02:45:37.892745  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:250: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.23.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m55.640876826s)

version_upgrade_test.go:255: (dbg) Run:  kubectl --context kubernetes-upgrade-20211203024403-532170 version --output=json

version_upgrade_test.go:274: Attempting to downgrade Kubernetes (should fail)

version_upgrade_test.go:276: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd

version_upgrade_test.go:276: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd: exit status 106 (116.416963ms)

-- stdout --

	* [kubernetes-upgrade-20211203024403-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

-- /stdout --

** stderr **

	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.23.0-beta.0 cluster to v1.16.0

	* Suggestion:

	    1) Recreate the cluster with Kubernetes 1.16.0, by running:

	    minikube delete -p kubernetes-upgrade-20211203024403-532170

	    minikube start -p kubernetes-upgrade-20211203024403-532170 --kubernetes-version=v1.16.0

	    2) Create a second cluster with Kubernetes 1.16.0, by running:

	    minikube start -p kubernetes-upgrade-20211203024403-5321702 --kubernetes-version=v1.16.0

	    3) Use the existing cluster at version Kubernetes 1.23.0-beta.0, by running:

	    minikube start -p kubernetes-upgrade-20211203024403-532170 --kubernetes-version=v1.23.0-beta.0

** /stderr **

version_upgrade_test.go:280: Attempting restart after unsuccessful downgrade

version_upgrade_test.go:282: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.23.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:282: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20211203024403-532170 --memory=2200 --kubernetes-version=v1.23.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (55.396152993s)

helpers_test.go:176: Cleaning up "kubernetes-upgrade-20211203024403-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-20211203024403-532170

=== CONT  TestKubernetesUpgrade

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20211203024403-532170: (3.924008965s)

--- PASS: TestKubernetesUpgrade (249.41s)

–

TestMissingContainerUpgrade (137.44s)

=== RUN   TestMissingContainerUpgrade

=== PAUSE TestMissingContainerUpgrade

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:316: (dbg) Run:  /tmp/minikube-v1.9.1.3184777553.exe start -p missing-upgrade-20211203024341-532170 --memory=2200 --driver=docker  --container-runtime=containerd

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:316: (dbg) Done: /tmp/minikube-v1.9.1.3184777553.exe start -p missing-upgrade-20211203024341-532170 --memory=2200 --driver=docker  --container-runtime=containerd: (1m14.966999924s)

version_upgrade_test.go:325: (dbg) Run:  docker stop missing-upgrade-20211203024341-532170

version_upgrade_test.go:325: (dbg) Done: docker stop missing-upgrade-20211203024341-532170: (10.447209504s)

version_upgrade_test.go:330: (dbg) Run:  docker rm missing-upgrade-20211203024341-532170

version_upgrade_test.go:336: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-20211203024341-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:336: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-20211203024341-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (47.872940507s)

helpers_test.go:176: Cleaning up "missing-upgrade-20211203024341-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-20211203024341-532170

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-20211203024341-532170: (3.120307003s)

--- PASS: TestMissingContainerUpgrade (137.44s)

–

TestNoKubernetes/serial/StartNoK8sWithVersion (0.13s)

=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion

no_kubernetes_test.go:79: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd

=== CONT  TestNoKubernetes/serial/StartNoK8sWithVersion

no_kubernetes_test.go:79: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (133.525178ms)

-- stdout --

	* [NoKubernetes-20211203024124-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

-- /stdout --

** stderr **

	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,

	to unset a global config run:

	$ minikube config unset kubernetes-version

** /stderr **

--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.13s)

–

TestStoppedBinaryUpgrade/Setup (1.38s)

=== RUN   TestStoppedBinaryUpgrade/Setup

--- PASS: TestStoppedBinaryUpgrade/Setup (1.38s)

–

TestPause/serial/Start (71.88s)

=== RUN   TestPause/serial/Start

pause_test.go:78: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20211203024124-532170 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd

=== CONT  TestPause/serial/Start

pause_test.go:78: (dbg) Done: out/minikube-linux-amd64 start -p pause-20211203024124-532170 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m11.884565498s)

--- PASS: TestPause/serial/Start (71.88s)

–

TestNoKubernetes/serial/Start (8.34s)

=== RUN   TestNoKubernetes/serial/Start

no_kubernetes_test.go:90: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --no-kubernetes --driver=docker  --container-runtime=containerd

=== CONT  TestNoKubernetes/serial/Start

no_kubernetes_test.go:90: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --no-kubernetes --driver=docker  --container-runtime=containerd: (8.337405729s)

--- PASS: TestNoKubernetes/serial/Start (8.34s)

–

TestStoppedBinaryUpgrade/Upgrade (153.14s)

=== RUN   TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Run:  /tmp/minikube-v1.16.0.784763582.exe start -p stopped-upgrade-20211203024124-532170 --memory=2200 --vm-driver=docker  --container-runtime=containerd

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Done: /tmp/minikube-v1.16.0.784763582.exe start -p stopped-upgrade-20211203024124-532170 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m38.026556397s)

version_upgrade_test.go:199: (dbg) Run:  /tmp/minikube-v1.16.0.784763582.exe -p stopped-upgrade-20211203024124-532170 stop

version_upgrade_test.go:199: (dbg) Done: /tmp/minikube-v1.16.0.784763582.exe -p stopped-upgrade-20211203024124-532170 stop: (1.362816945s)

version_upgrade_test.go:205: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-20211203024124-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

E1203 02:43:05.911798  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:205: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-20211203024124-532170 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (53.745265253s)

--- PASS: TestStoppedBinaryUpgrade/Upgrade (153.14s)

–

TestNoKubernetes/serial/VerifyK8sNotRunning (0.37s)

=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning

no_kubernetes_test.go:101: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-20211203024124-532170 "sudo systemctl is-active --quiet service kubelet"

no_kubernetes_test.go:101: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-20211203024124-532170 "sudo systemctl is-active --quiet service kubelet": exit status 1 (372.93885ms)

** stderr **

	ssh: Process exited with status 3

** /stderr **

--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.37s)

–

TestNoKubernetes/serial/ProfileList (1.45s)

=== RUN   TestNoKubernetes/serial/ProfileList

no_kubernetes_test.go:123: (dbg) Run:  out/minikube-linux-amd64 profile list

no_kubernetes_test.go:133: (dbg) Run:  out/minikube-linux-amd64 profile list --output=json

--- PASS: TestNoKubernetes/serial/ProfileList (1.45s)

–

TestNoKubernetes/serial/Stop (1.41s)

=== RUN   TestNoKubernetes/serial/Stop

no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-amd64 stop -p NoKubernetes-20211203024124-532170

no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-20211203024124-532170: (1.413479412s)

--- PASS: TestNoKubernetes/serial/Stop (1.41s)

–

TestNoKubernetes/serial/StartNoArgs (17.09s)

=== RUN   TestNoKubernetes/serial/StartNoArgs

no_kubernetes_test.go:145: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --driver=docker  --container-runtime=containerd

no_kubernetes_test.go:145: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-20211203024124-532170 --driver=docker  --container-runtime=containerd: (17.090801301s)

--- PASS: TestNoKubernetes/serial/StartNoArgs (17.09s)

–

TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.49s)

=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond

no_kubernetes_test.go:101: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-20211203024124-532170 "sudo systemctl is-active --quiet service kubelet"

no_kubernetes_test.go:101: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-20211203024124-532170 "sudo systemctl is-active --quiet service kubelet": exit status 1 (492.845494ms)

** stderr **

	ssh: Process exited with status 3

** /stderr **

--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.49s)

–

TestNetworkPlugins/group/false (1.04s)

=== RUN   TestNetworkPlugins/group/false

net_test.go:214: (dbg) Run:  out/minikube-linux-amd64 start -p false-20211203024201-532170 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd

net_test.go:214: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-20211203024201-532170 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (368.218311ms)

-- stdout --

	* [false-20211203024201-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	  - MINIKUBE_LOCATION=12084

	* Using the docker driver based on user configuration

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

-- /stdout --

** stderr **

	I1203 02:42:01.889893  659112 out.go:297] Setting OutFile to fd 1 ...

	I1203 02:42:01.890014  659112 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:01.890026  659112 out.go:310] Setting ErrFile to fd 2...

	I1203 02:42:01.890032  659112 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1203 02:42:01.890182  659112 root.go:315] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/bin

	I1203 02:42:01.890501  659112 out.go:304] Setting JSON to false

	I1203 02:42:01.946282  659112 start.go:112] hostinfo: {"hostname":"debian-jenkins-agent-9","uptime":15883,"bootTime":1638483439,"procs":256,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I1203 02:42:01.946419  659112 start.go:122] virtualization: kvm guest

	I1203 02:42:01.949323  659112 out.go:176] * [false-20211203024201-532170] minikube v1.24.0 on Debian 9.13 (kvm/amd64)

	I1203 02:42:01.951670  659112 out.go:176]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/kubeconfig

	I1203 02:42:01.949572  659112 notify.go:174] Checking for updates...

	I1203 02:42:01.953338  659112 out.go:176]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1203 02:42:01.954874  659112 out.go:176]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube

	I1203 02:42:01.956414  659112 out.go:176]   - MINIKUBE_LOCATION=12084

	I1203 02:42:01.957066  659112 config.go:176] Loaded profile config "offline-containerd-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:42:01.957238  659112 config.go:176] Loaded profile config "pause-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.22.4

	I1203 02:42:01.957331  659112 config.go:176] Loaded profile config "stopped-upgrade-20211203024124-532170": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1203 02:42:01.957386  659112 driver.go:343] Setting default libvirt URI to qemu:///system

	I1203 02:42:02.031847  659112 docker.go:132] docker version: linux-19.03.15

	I1203 02:42:02.031979  659112 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1203 02:42:02.158854  659112 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:222 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:60 SystemTime:2021-12-03 02:42:02.086972323 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742200832 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-9 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I1203 02:42:02.158992  659112 docker.go:237] overlay module found

	I1203 02:42:02.161443  659112 out.go:176] * Using the docker driver based on user configuration

	I1203 02:42:02.161495  659112 start.go:280] selected driver: docker

	I1203 02:42:02.161509  659112 start.go:775] validating driver "docker" against <nil>

	I1203 02:42:02.161541  659112 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W1203 02:42:02.161604  659112 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W1203 02:42:02.161645  659112 out.go:241] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I1203 02:42:02.163175  659112 out.go:176]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I1203 02:42:02.165340  659112 out.go:176]

	W1203 02:42:02.165460  659112 out.go:241] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI

	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI

	I1203 02:42:02.166864  659112 out.go:176]

** /stderr **

helpers_test.go:176: Cleaning up "false-20211203024201-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p false-20211203024201-532170

--- PASS: TestNetworkPlugins/group/false (1.04s)

–

TestPause/serial/SecondStartNoReconfiguration (16.04s)

=== RUN   TestPause/serial/SecondStartNoReconfiguration

pause_test.go:90: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20211203024124-532170 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

=== CONT  TestPause/serial/SecondStartNoReconfiguration

pause_test.go:90: (dbg) Done: out/minikube-linux-amd64 start -p pause-20211203024124-532170 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (16.013603074s)

--- PASS: TestPause/serial/SecondStartNoReconfiguration (16.04s)

–

TestPause/serial/Unpause (0.86s)

=== RUN   TestPause/serial/Unpause

pause_test.go:119: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-20211203024124-532170 --alsologtostderr -v=5

--- PASS: TestPause/serial/Unpause (0.86s)

–

TestStoppedBinaryUpgrade/MinikubeLogs (1.07s)

=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs

version_upgrade_test.go:213: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-20211203024124-532170

version_upgrade_test.go:213: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-20211203024124-532170: (1.074605172s)

--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.07s)

–

TestPause/serial/DeletePaused (10.92s)

=== RUN   TestPause/serial/DeletePaused

pause_test.go:130: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-20211203024124-532170 --alsologtostderr -v=5

pause_test.go:130: (dbg) Done: out/minikube-linux-amd64 delete -p pause-20211203024124-532170 --alsologtostderr -v=5: (10.92114301s)

--- PASS: TestPause/serial/DeletePaused (10.92s)

–

TestPause/serial/VerifyDeletedResources (0.75s)

=== RUN   TestPause/serial/VerifyDeletedResources

pause_test.go:140: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

pause_test.go:166: (dbg) Run:  docker ps -a

pause_test.go:171: (dbg) Run:  docker volume inspect pause-20211203024124-532170

pause_test.go:171: (dbg) Non-zero exit: docker volume inspect pause-20211203024124-532170: exit status 1 (41.410955ms)

-- stdout --

[]

-- /stdout --

** stderr **

	Error: No such volume: pause-20211203024124-532170

** /stderr **

pause_test.go:176: (dbg) Run:  sudo docker network ls

--- PASS: TestPause/serial/VerifyDeletedResources (0.75s)

–

TestStartStop/group/old-k8s-version/serial/FirstStart (122.25s)

=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20211203024648-532170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0

E1203 02:47:07.765732  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

=== CONT  TestStartStop/group/old-k8s-version/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20211203024648-532170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (2m2.248452062s)

--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (122.25s)

–

TestStartStop/group/embed-certs/serial/FirstStart (79.65s)

=== RUN   TestStartStop/group/embed-certs/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20211203024808-532170 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4

=== CONT  TestStartStop/group/embed-certs/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20211203024808-532170 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4: (1m19.64946959s)

--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (79.65s)

–

TestStartStop/group/no-preload/serial/FirstStart (88.2s)

=== RUN   TestStartStop/group/no-preload/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20211203024813-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0

=== CONT  TestStartStop/group/no-preload/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20211203024813-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0: (1m28.197206829s)

--- PASS: TestStartStop/group/no-preload/serial/FirstStart (88.20s)

–

TestStartStop/group/old-k8s-version/serial/DeployApp (9.59s)

=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20211203024648-532170 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [5855a770-1cb6-4452-bb87-fdf765c15806] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [5855a770-1cb6-4452-bb87-fdf765c15806] Running

start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.012634086s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20211203024648-532170 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.59s)

–

TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.64s)

=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-20211203024648-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context old-k8s-version-20211203024648-532170 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.64s)

–

TestStartStop/group/old-k8s-version/serial/Stop (21.14s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-20211203024648-532170 --alsologtostderr -v=3

=== CONT  TestStartStop/group/old-k8s-version/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-20211203024648-532170 --alsologtostderr -v=3: (21.136198157s)

--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (21.14s)

–

TestStartStop/group/default-k8s-different-port/serial/FirstStart (70.8s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20211203024904-532170 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4

=== CONT  TestStartStop/group/default-k8s-different-port/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20211203024904-532170 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4: (1m10.804599444s)

--- PASS: TestStartStop/group/default-k8s-different-port/serial/FirstStart (70.80s)

–

TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170: exit status 7 (104.467352ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-20211203024648-532170 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

–

TestStartStop/group/old-k8s-version/serial/SecondStart (438.08s)

=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20211203024648-532170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0

=== CONT  TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20211203024648-532170 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (7m17.563055847s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (438.08s)

–

TestStartStop/group/embed-certs/serial/DeployApp (10.48s)

=== RUN   TestStartStop/group/embed-certs/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20211203024808-532170 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [4116b2cf-4ad8-4df8-8905-8094c8da3dda] Pending

helpers_test.go:343: "busybox" [4116b2cf-4ad8-4df8-8905-8094c8da3dda] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [4116b2cf-4ad8-4df8-8905-8094c8da3dda] Running

start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 10.016441899s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20211203024808-532170 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (10.48s)

–

TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.36s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20211203024808-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:190: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20211203024808-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.248588364s)

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context embed-certs-20211203024808-532170 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.36s)

–

TestStartStop/group/embed-certs/serial/Stop (20.9s)

=== RUN   TestStartStop/group/embed-certs/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-20211203024808-532170 --alsologtostderr -v=3

=== CONT  TestStartStop/group/embed-certs/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-20211203024808-532170 --alsologtostderr -v=3: (20.904463315s)

--- PASS: TestStartStop/group/embed-certs/serial/Stop (20.90s)

–

TestStartStop/group/no-preload/serial/DeployApp (13.49s)

=== RUN   TestStartStop/group/no-preload/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20211203024813-532170 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [6742df42-bc48-4ee3-9ee9-766a3103d678] Pending

helpers_test.go:343: "busybox" [6742df42-bc48-4ee3-9ee9-766a3103d678] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [6742df42-bc48-4ee3-9ee9-766a3103d678] Running

start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 13.011374188s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20211203024813-532170 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/no-preload/serial/DeployApp (13.49s)

–

TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.68s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20211203024813-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context no-preload-20211203024813-532170 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.68s)

–

TestStartStop/group/no-preload/serial/Stop (21.07s)

=== RUN   TestStartStop/group/no-preload/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-20211203024813-532170 --alsologtostderr -v=3

=== CONT  TestStartStop/group/no-preload/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-20211203024813-532170 --alsologtostderr -v=3: (21.068588552s)

--- PASS: TestStartStop/group/no-preload/serial/Stop (21.07s)

–

TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170: exit status 7 (110.880177ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20211203024808-532170 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.23s)

–

TestStartStop/group/embed-certs/serial/SecondStart (328.32s)

=== RUN   TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20211203024808-532170 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4

E1203 02:50:10.814450  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20211203024808-532170 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4: (5m27.841046919s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (328.32s)

–

TestStartStop/group/default-k8s-different-port/serial/DeployApp (10.47s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20211203024904-532170 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [bc7a3ea0-ee1b-425c-9a8d-2622ae24e966] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

helpers_test.go:343: "busybox" [bc7a3ea0-ee1b-425c-9a8d-2622ae24e966] Running

start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: integration-test=busybox healthy within 10.017483006s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20211203024904-532170 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/default-k8s-different-port/serial/DeployApp (10.47s)

–

TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170: exit status 7 (100.150138ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-20211203024813-532170 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

–

TestStartStop/group/no-preload/serial/SecondStart (337.2s)

=== RUN   TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20211203024813-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0

=== CONT  TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20211203024813-532170 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0: (5m36.598839026s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

--- PASS: TestStartStop/group/no-preload/serial/SecondStart (337.20s)

–

TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.74s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20211203024904-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context default-k8s-different-port-20211203024904-532170 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.74s)

–

TestStartStop/group/default-k8s-different-port/serial/Stop (20.73s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-different-port-20211203024904-532170 --alsologtostderr -v=3

E1203 02:50:37.892716  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-different-port-20211203024904-532170 --alsologtostderr -v=3: (20.732186907s)

--- PASS: TestStartStop/group/default-k8s-different-port/serial/Stop (20.73s)

–

TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.21s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170: exit status 7 (100.911516ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-different-port-20211203024904-532170 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.21s)

–

TestStartStop/group/default-k8s-different-port/serial/SecondStart (328.84s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20211203024904-532170 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4

E1203 02:52:07.765738  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

E1203 02:53:05.912260  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

=== CONT  TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20211203024904-532170 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.22.4: (5m28.304957812s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

--- PASS: TestStartStop/group/default-k8s-different-port/serial/SecondStart (328.84s)

–

TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-654cf69797-qcdcb" [e253b752-db6c-4696-a5c8-56aed6429c08] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.017246738s

--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.02s)

–

TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.09s)

=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-654cf69797-qcdcb" [e253b752-db6c-4696-a5c8-56aed6429c08] Running

E1203 02:55:37.892280  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007579659s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context embed-certs-20211203024808-532170 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.09s)

–

TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.39s)

=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p embed-certs-20211203024808-532170 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5

start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc

--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.39s)

–

TestStartStop/group/embed-certs/serial/Pause (3.14s)

=== RUN   TestStartStop/group/embed-certs/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-20211203024808-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170: exit status 2 (405.609514ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170: exit status 2 (414.085134ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p embed-certs-20211203024808-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-20211203024808-532170 -n embed-certs-20211203024808-532170

--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.14s)

–

TestStartStop/group/newest-cni/serial/FirstStart (95.78s)

=== RUN   TestStartStop/group/newest-cni/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20211203025547-532170 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0

=== CONT  TestStartStop/group/newest-cni/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20211203025547-532170 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0: (1m35.783364936s)

--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (95.78s)

–

TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (5.02s)

=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-557fcd6d89-9pnwq" [314f46a9-4429-4e3a-a1d5-e85a54e464f4] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.013672063s

--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (5.02s)

–

TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.15s)

=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-557fcd6d89-9pnwq" [314f46a9-4429-4e3a-a1d5-e85a54e464f4] Running

start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.070369718s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context no-preload-20211203024813-532170 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.15s)

–

TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.39s)

=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-20211203024813-532170 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5

start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc

--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.39s)

–

TestStartStop/group/no-preload/serial/Pause (3.97s)

=== RUN   TestStartStop/group/no-preload/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-20211203024813-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170: exit status 2 (507.196558ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170: exit status 2 (527.064236ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-20211203024813-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Done: out/minikube-linux-amd64 unpause -p no-preload-20211203024813-532170 --alsologtostderr -v=1: (1.015549604s)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20211203024813-532170 -n no-preload-20211203024813-532170

--- PASS: TestStartStop/group/no-preload/serial/Pause (3.97s)

–

TestNetworkPlugins/group/auto/Start (81.97s)

=== RUN   TestNetworkPlugins/group/auto/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p auto-20211203024159-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd

=== CONT  TestNetworkPlugins/group/auto/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p auto-20211203024159-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=containerd: (1m21.967434442s)

--- PASS: TestNetworkPlugins/group/auto/Start (81.97s)

–

TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (5.02s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-654cf69797-mb29l" [15a83b99-7140-434e-af62-2563087f8e8b] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.015133803s

--- PASS: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (5.02s)

–

TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.1s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-654cf69797-mb29l" [15a83b99-7140-434e-af62-2563087f8e8b] Running

start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007181864s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context default-k8s-different-port-20211203024904-532170 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.10s)

–

TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.4s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p default-k8s-different-port-20211203024904-532170 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5

start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc

--- PASS: TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.40s)

–

TestStartStop/group/default-k8s-different-port/serial/Pause (12.99s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-different-port-20211203024904-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170: exit status 2 (450.948248ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170: exit status 2 (430.56479ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-different-port-20211203024904-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Done: out/minikube-linux-amd64 unpause -p default-k8s-different-port-20211203024904-532170 --alsologtostderr -v=1: (5.626992154s)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

start_stop_delete_test.go:296: (dbg) Done: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170: (5.142560748s)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20211203024904-532170 -n default-k8s-different-port-20211203024904-532170

--- PASS: TestStartStop/group/default-k8s-different-port/serial/Pause (12.99s)

–

TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-766959b846-7jzfj" [9e0a99a5-7197-4523-9bf6-7ea74c37034b] Running

=== CONT  TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.014377647s

--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.02s)

–

TestNetworkPlugins/group/cilium/Start (92.79s)

=== RUN   TestNetworkPlugins/group/cilium/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p cilium-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd

=== CONT  TestNetworkPlugins/group/cilium/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p cilium-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=containerd: (1m32.794039756s)

--- PASS: TestNetworkPlugins/group/cilium/Start (92.79s)

–

TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)

=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-766959b846-7jzfj" [9e0a99a5-7197-4523-9bf6-7ea74c37034b] Running

start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006519267s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context old-k8s-version-20211203024648-532170 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)

–

TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.4s)

=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p old-k8s-version-20211203024648-532170 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5

start_stop_delete_test.go:289: Found non-minikube image: library/busybox:1.28.4-glibc

--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.40s)

–

TestStartStop/group/old-k8s-version/serial/Pause (3.37s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-20211203024648-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170: exit status 2 (473.792162ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170: exit status 2 (435.030271ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-20211203024648-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20211203024648-532170 -n old-k8s-version-20211203024648-532170

--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.37s)

–

TestNetworkPlugins/group/calico/Start (82.77s)

=== RUN   TestNetworkPlugins/group/calico/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p calico-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd

E1203 02:57:07.765349  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/addons-20211203020952-532170/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/calico/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p calico-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=containerd: (1m22.764914667s)

--- PASS: TestNetworkPlugins/group/calico/Start (82.77s)

–

TestStartStop/group/newest-cni/serial/DeployApp (0s)

=== RUN   TestStartStop/group/newest-cni/serial/DeployApp

--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

–

TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.74s)

=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-20211203025547-532170 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:196: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.74s)

–

TestStartStop/group/newest-cni/serial/Stop (20.9s)

=== RUN   TestStartStop/group/newest-cni/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-20211203025547-532170 --alsologtostderr -v=3

=== CONT  TestStartStop/group/newest-cni/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-20211203025547-532170 --alsologtostderr -v=3: (20.895605341s)

--- PASS: TestStartStop/group/newest-cni/serial/Stop (20.90s)

–

TestNetworkPlugins/group/auto/KubeletFlags (0.37s)

=== RUN   TestNetworkPlugins/group/auto/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-20211203024159-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.37s)

–

TestNetworkPlugins/group/auto/NetCatPod (9.25s)

=== RUN   TestNetworkPlugins/group/auto/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context auto-20211203024159-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-dzwhp" [ae6e85fc-badf-4fcb-9b95-bd60d7acbfa2] Pending

helpers_test.go:343: "netcat-7bfd7f67bc-dzwhp" [ae6e85fc-badf-4fcb-9b95-bd60d7acbfa2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

helpers_test.go:343: "netcat-7bfd7f67bc-dzwhp" [ae6e85fc-badf-4fcb-9b95-bd60d7acbfa2] Running

=== CONT  TestNetworkPlugins/group/auto/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.009696204s

--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.25s)

–

TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.26s)

=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170: exit status 7 (130.612619ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-20211203025547-532170 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.26s)

–

TestStartStop/group/newest-cni/serial/SecondStart (76.69s)

=== RUN   TestStartStop/group/newest-cni/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20211203025547-532170 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0

=== CONT  TestStartStop/group/newest-cni/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20211203025547-532170 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.23.0-beta.0: (1m16.277529357s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (76.69s)

–

TestNetworkPlugins/group/auto/DNS (0.27s)

=== RUN   TestNetworkPlugins/group/auto/DNS

net_test.go:163: (dbg) Run:  kubectl --context auto-20211203024159-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/auto/DNS (0.27s)

–

TestNetworkPlugins/group/auto/Localhost (0.17s)

=== RUN   TestNetworkPlugins/group/auto/Localhost

net_test.go:182: (dbg) Run:  kubectl --context auto-20211203024159-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/auto/Localhost (0.17s)

–

TestNetworkPlugins/group/auto/HairPin (0.19s)

=== RUN   TestNetworkPlugins/group/auto/HairPin

net_test.go:232: (dbg) Run:  kubectl --context auto-20211203024159-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/auto/HairPin (0.19s)

–

TestNetworkPlugins/group/custom-weave/Start (83.12s)

=== RUN   TestNetworkPlugins/group/custom-weave/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p custom-weave-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=containerd

E1203 02:58:05.911439  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/functional-20211203021548-532170/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/custom-weave/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p custom-weave-20211203024202-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=containerd: (1m23.119072382s)

--- PASS: TestNetworkPlugins/group/custom-weave/Start (83.12s)

–

TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

=== RUN   TestNetworkPlugins/group/cilium/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: waiting 10m0s for pods matching "k8s-app=cilium" in namespace "kube-system" ...

helpers_test.go:343: "cilium-cdwm8" [823fad16-449a-4b1b-a8d6-6e01eadf8b8b] Running

=== CONT  TestNetworkPlugins/group/cilium/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: k8s-app=cilium healthy within 5.018183071s

--- PASS: TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

–

TestNetworkPlugins/group/calico/ControllerPod (5.02s)

=== RUN   TestNetworkPlugins/group/calico/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...

helpers_test.go:343: "calico-node-jg5j6" [e57aa39c-139e-447e-9c5a-5d29cf9f6a05] Running

=== CONT  TestNetworkPlugins/group/calico/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.016061315s

--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.02s)

–

TestNetworkPlugins/group/cilium/KubeletFlags (0.64s)

=== RUN   TestNetworkPlugins/group/cilium/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p cilium-20211203024202-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/cilium/KubeletFlags (0.64s)

–

TestNetworkPlugins/group/cilium/NetCatPod (12.21s)

=== RUN   TestNetworkPlugins/group/cilium/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context cilium-20211203024202-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:132: (dbg) Done: kubectl --context cilium-20211203024202-532170 replace --force -f testdata/netcat-deployment.yaml: (1.165488654s)

net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-zv9mf" [d4d95073-35a2-4486-afd2-7b37c22a0209] Pending

helpers_test.go:343: "netcat-7bfd7f67bc-zv9mf" [d4d95073-35a2-4486-afd2-7b37c22a0209] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/cilium/NetCatPod

helpers_test.go:343: "netcat-7bfd7f67bc-zv9mf" [d4d95073-35a2-4486-afd2-7b37c22a0209] Running

=== CONT  TestNetworkPlugins/group/cilium/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: app=netcat healthy within 11.007105121s

--- PASS: TestNetworkPlugins/group/cilium/NetCatPod (12.21s)

–

TestNetworkPlugins/group/calico/KubeletFlags (0.48s)

=== RUN   TestNetworkPlugins/group/calico/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-20211203024202-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.48s)

–

TestNetworkPlugins/group/calico/NetCatPod (9.4s)

=== RUN   TestNetworkPlugins/group/calico/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context calico-20211203024202-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-9x5gf" [d40464cc-0079-447d-bc9e-c7420c9c973a] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/calico/NetCatPod

helpers_test.go:343: "netcat-7bfd7f67bc-9x5gf" [d40464cc-0079-447d-bc9e-c7420c9c973a] Running

=== CONT  TestNetworkPlugins/group/calico/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 9.009412373s

--- PASS: TestNetworkPlugins/group/calico/NetCatPod (9.40s)

–

TestNetworkPlugins/group/cilium/DNS (0.17s)

=== RUN   TestNetworkPlugins/group/cilium/DNS

net_test.go:163: (dbg) Run:  kubectl --context cilium-20211203024202-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/cilium/DNS (0.17s)

–

TestNetworkPlugins/group/cilium/Localhost (0.16s)

=== RUN   TestNetworkPlugins/group/cilium/Localhost

net_test.go:182: (dbg) Run:  kubectl --context cilium-20211203024202-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/cilium/Localhost (0.16s)

–

TestNetworkPlugins/group/cilium/HairPin (0.15s)

=== RUN   TestNetworkPlugins/group/cilium/HairPin

net_test.go:232: (dbg) Run:  kubectl --context cilium-20211203024202-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/cilium/HairPin (0.15s)

–

TestNetworkPlugins/group/calico/DNS (0.17s)

=== RUN   TestNetworkPlugins/group/calico/DNS

net_test.go:163: (dbg) Run:  kubectl --context calico-20211203024202-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/calico/DNS (0.17s)

–

TestNetworkPlugins/group/calico/Localhost (0.21s)

=== RUN   TestNetworkPlugins/group/calico/Localhost

net_test.go:182: (dbg) Run:  kubectl --context calico-20211203024202-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/calico/Localhost (0.21s)

–

TestNetworkPlugins/group/calico/HairPin (0.18s)

=== RUN   TestNetworkPlugins/group/calico/HairPin

net_test.go:232: (dbg) Run:  kubectl --context calico-20211203024202-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/calico/HairPin (0.18s)

–

TestNetworkPlugins/group/kindnet/Start (74.61s)

=== RUN   TestNetworkPlugins/group/kindnet/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-20211203024201-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd

=== CONT  TestNetworkPlugins/group/kindnet/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-20211203024201-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m14.608780895s)

--- PASS: TestNetworkPlugins/group/kindnet/Start (74.61s)

–

TestNetworkPlugins/group/enable-default-cni/Start (69.01s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-20211203024200-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd

E1203 02:58:40.941754  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

E1203 02:58:51.137207  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.142510  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.152799  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.173144  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.213434  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.293785  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.454213  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:51.775280  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:52.415893  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:53.697023  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:58:56.257345  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:59:01.378294  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/enable-default-cni/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-20211203024200-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m9.011852084s)

--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (69.01s)

–

TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop

start_stop_delete_test.go:258: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

–

TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop

start_stop_delete_test.go:269: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

–

TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.38s)

=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p newest-cni-20211203025547-532170 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5

--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.38s)

–

TestStartStop/group/newest-cni/serial/Pause (3s)

=== RUN   TestStartStop/group/newest-cni/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-20211203025547-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170: exit status 2 (402.479786ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170: exit status 2 (400.266655ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-20211203025547-532170 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20211203025547-532170 -n newest-cni-20211203025547-532170

--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.00s)

E1203 02:59:32.099561  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

E1203 02:59:41.875569  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:41.880850  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:41.891176  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:41.911498  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:41.951824  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:42.032150  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:42.192562  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:42.513190  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:43.153600  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:44.434717  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

E1203 02:59:46.995174  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

–

TestNetworkPlugins/group/bridge/Start (59.41s)

=== RUN   TestNetworkPlugins/group/bridge/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-20211203024200-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd

E1203 02:59:11.619018  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/old-k8s-version-20211203024648-532170/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/bridge/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p bridge-20211203024200-532170 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=containerd: (59.407027753s)

--- PASS: TestNetworkPlugins/group/bridge/Start (59.41s)

–

TestNetworkPlugins/group/custom-weave/KubeletFlags (0.4s)

=== RUN   TestNetworkPlugins/group/custom-weave/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-weave-20211203024202-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/custom-weave/KubeletFlags (0.40s)

–

TestNetworkPlugins/group/custom-weave/NetCatPod (10.22s)

=== RUN   TestNetworkPlugins/group/custom-weave/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context custom-weave-20211203024202-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-mcm2q" [8fb06d9f-0b27-4b06-b0e8-556117436f08] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

helpers_test.go:343: "netcat-7bfd7f67bc-mcm2q" [8fb06d9f-0b27-4b06-b0e8-556117436f08] Running

net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: app=netcat healthy within 10.014857782s

--- PASS: TestNetworkPlugins/group/custom-weave/NetCatPod (10.22s)

–

TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.41s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-20211203024200-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.41s)

–

TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.37s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context enable-default-cni-20211203024200-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-jdj4d" [dd353064-46f5-4b15-91b3-00b6ed04d8f7] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

E1203 02:59:52.115569  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

helpers_test.go:343: "netcat-7bfd7f67bc-jdj4d" [dd353064-46f5-4b15-91b3-00b6ed04d8f7] Running

=== CONT  TestNetworkPlugins/group/enable-default-cni/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.006595365s

--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.37s)

–

TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...

helpers_test.go:343: "kindnet-lpwp4" [8ce7dd7f-b9db-476b-b5c8-2d14df200d46] Running

=== CONT  TestNetworkPlugins/group/kindnet/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.014088458s

--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.02s)

–

TestNetworkPlugins/group/enable-default-cni/DNS (0.2s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS

net_test.go:163: (dbg) Run:  kubectl --context enable-default-cni-20211203024200-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.20s)

–

TestNetworkPlugins/group/enable-default-cni/Localhost (0.17s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost

net_test.go:182: (dbg) Run:  kubectl --context enable-default-cni-20211203024200-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.17s)

–

TestNetworkPlugins/group/kindnet/KubeletFlags (0.47s)

=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-20211203024201-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.47s)

–

TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin

net_test.go:232: (dbg) Run:  kubectl --context enable-default-cni-20211203024200-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

–

TestNetworkPlugins/group/kindnet/NetCatPod (9.35s)

=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context kindnet-20211203024201-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-ph2br" [eef91d3b-5721-4d74-b8cf-647a8daa1e34] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

E1203 03:00:02.356681  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/no-preload-20211203024813-532170/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod

helpers_test.go:343: "netcat-7bfd7f67bc-ph2br" [eef91d3b-5721-4d74-b8cf-647a8daa1e34] Running

=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.037431913s

--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.35s)

–

TestNetworkPlugins/group/bridge/KubeletFlags (0.37s)

=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-20211203024200-532170 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.37s)

–

TestNetworkPlugins/group/bridge/NetCatPod (10.33s)

=== RUN   TestNetworkPlugins/group/bridge/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context bridge-20211203024200-532170 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-7bfd7f67bc-7czwb" [c8e9336c-ac8c-4f83-9cc1-adfe7cd8b9de] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/bridge/NetCatPod

helpers_test.go:343: "netcat-7bfd7f67bc-7czwb" [c8e9336c-ac8c-4f83-9cc1-adfe7cd8b9de] Running

E1203 03:00:16.079361  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.084685  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.094985  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.115334  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.155703  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.236079  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.396540  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:16.716885  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:17.357030  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

E1203 03:00:18.637488  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/default-k8s-different-port-20211203024904-532170/client.crt: no such file or directory

net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.016334966s

--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.33s)

–

TestNetworkPlugins/group/kindnet/DNS (0.16s)

=== RUN   TestNetworkPlugins/group/kindnet/DNS

net_test.go:163: (dbg) Run:  kubectl --context kindnet-20211203024201-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.16s)

–

TestNetworkPlugins/group/kindnet/Localhost (0.17s)

=== RUN   TestNetworkPlugins/group/kindnet/Localhost

net_test.go:182: (dbg) Run:  kubectl --context kindnet-20211203024201-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.17s)

–

TestNetworkPlugins/group/kindnet/HairPin (0.14s)

=== RUN   TestNetworkPlugins/group/kindnet/HairPin

net_test.go:232: (dbg) Run:  kubectl --context kindnet-20211203024201-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.14s)

–

TestNetworkPlugins/group/bridge/DNS (0.16s)

=== RUN   TestNetworkPlugins/group/bridge/DNS

net_test.go:163: (dbg) Run:  kubectl --context bridge-20211203024200-532170 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/bridge/DNS (0.16s)

–

TestNetworkPlugins/group/bridge/Localhost (0.14s)

=== RUN   TestNetworkPlugins/group/bridge/Localhost

net_test.go:182: (dbg) Run:  kubectl --context bridge-20211203024200-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.14s)

–

TestNetworkPlugins/group/bridge/HairPin (0.15s)

=== RUN   TestNetworkPlugins/group/bridge/HairPin

net_test.go:232: (dbg) Run:  kubectl --context bridge-20211203024200-532170 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.15s)

Test skip (24/283)

Order	skiped test	Duration
5	TestDownloadOnly/v1.16.0/cached-images	0
6	TestDownloadOnly/v1.16.0/binaries	0
7	TestDownloadOnly/v1.16.0/kubectl	0
12	TestDownloadOnly/v1.22.4/cached-images	0
13	TestDownloadOnly/v1.22.4/binaries	0
14	TestDownloadOnly/v1.22.4/kubectl	0
19	TestDownloadOnly/v1.23.0-beta.0/cached-images	0
20	TestDownloadOnly/v1.23.0-beta.0/binaries	0
21	TestDownloadOnly/v1.23.0-beta.0/kubectl	0
41	TestDockerFlags	0
45	TestHyperKitDriverInstallOrUpdate	0
46	TestHyperkitDriverSkipUpgrade	0
95	TestFunctional/parallel/DockerEnv	0
96	TestFunctional/parallel/PodmanEnv	0
118	TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig	0
119	TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil	0
120	TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS	0
134	TestGvisorAddon	0
200	TestChangeNoneUser	0
203	TestScheduledStopWindows	0
205	TestSkaffold	0
220	TestStartStop/group/disable-driver-mounts	0.6
233	TestNetworkPlugins/group/kubenet	0.94
236	TestNetworkPlugins/group/flannel	0.88

–

TestDownloadOnly/v1.16.0/cached-images (0s)

=== RUN   TestDownloadOnly/v1.16.0/cached-images

aaa_download_only_test.go:119: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

–

TestDownloadOnly/v1.16.0/binaries (0s)

=== RUN   TestDownloadOnly/v1.16.0/binaries

aaa_download_only_test.go:138: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

–

TestDownloadOnly/v1.16.0/kubectl (0s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

aaa_download_only_test.go:154: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

–

TestDownloadOnly/v1.22.4/cached-images (0s)

=== RUN   TestDownloadOnly/v1.22.4/cached-images

aaa_download_only_test.go:119: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.22.4/cached-images (0.00s)

–

TestDownloadOnly/v1.22.4/binaries (0s)

=== RUN   TestDownloadOnly/v1.22.4/binaries

aaa_download_only_test.go:138: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.22.4/binaries (0.00s)

–

TestDownloadOnly/v1.22.4/kubectl (0s)

=== RUN   TestDownloadOnly/v1.22.4/kubectl

aaa_download_only_test.go:154: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.22.4/kubectl (0.00s)

–

TestDownloadOnly/v1.23.0-beta.0/cached-images (0s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/cached-images

aaa_download_only_test.go:119: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.23.0-beta.0/cached-images (0.00s)

–

TestDownloadOnly/v1.23.0-beta.0/binaries (0s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/binaries

aaa_download_only_test.go:138: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.23.0-beta.0/binaries (0.00s)

–

TestDownloadOnly/v1.23.0-beta.0/kubectl (0s)

=== RUN   TestDownloadOnly/v1.23.0-beta.0/kubectl

aaa_download_only_test.go:154: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.23.0-beta.0/kubectl (0.00s)

–

TestDockerFlags (0s)

=== RUN   TestDockerFlags

docker_test.go:36: skipping: only runs with docker container runtime, currently testing containerd

--- SKIP: TestDockerFlags (0.00s)

–

TestHyperKitDriverInstallOrUpdate (0s)

=== RUN   TestHyperKitDriverInstallOrUpdate

driver_install_or_update_test.go:114: Skip if not darwin.

--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

–

TestHyperkitDriverSkipUpgrade (0s)

=== RUN   TestHyperkitDriverSkipUpgrade

driver_install_or_update_test.go:187: Skip if not darwin.

--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

–

TestFunctional/parallel/DockerEnv (0s)

=== RUN   TestFunctional/parallel/DockerEnv

=== PAUSE TestFunctional/parallel/DockerEnv

=== CONT  TestFunctional/parallel/DockerEnv

functional_test.go:438: only validate docker env with docker container runtime, currently testing containerd

--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

–

TestFunctional/parallel/PodmanEnv (0s)

=== RUN   TestFunctional/parallel/PodmanEnv

=== PAUSE TestFunctional/parallel/PodmanEnv

=== CONT  TestFunctional/parallel/PodmanEnv

functional_test.go:528: only validate podman env with docker container runtime, currently testing containerd

--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig

functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil

functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS

functional_test_tunnel_test.go:97: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

–

TestGvisorAddon (0s)

=== RUN   TestGvisorAddon

gvisor_addon_test.go:35: skipping test because --gvisor=false

--- SKIP: TestGvisorAddon (0.00s)

–

TestChangeNoneUser (0s)

=== RUN   TestChangeNoneUser

none_test.go:39: Only test none driver.

--- SKIP: TestChangeNoneUser (0.00s)

–

TestScheduledStopWindows (0s)

=== RUN   TestScheduledStopWindows

scheduled_stop_test.go:43: test only runs on windows

--- SKIP: TestScheduledStopWindows (0.00s)

–

TestSkaffold (0s)

=== RUN   TestSkaffold

skaffold_test.go:43: skaffold requires docker-env, currently testing containerd container runtime

--- SKIP: TestSkaffold (0.00s)

–

TestStartStop/group/disable-driver-mounts (0.6s)

=== RUN   TestStartStop/group/disable-driver-mounts

=== PAUSE TestStartStop/group/disable-driver-mounts

=== CONT  TestStartStop/group/disable-driver-mounts

start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox

helpers_test.go:176: Cleaning up "disable-driver-mounts-20211203024812-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-20211203024812-532170

--- SKIP: TestStartStop/group/disable-driver-mounts (0.60s)

–

TestNetworkPlugins/group/kubenet (0.94s)

=== RUN   TestNetworkPlugins/group/kubenet

net_test.go:89: Skipping the test as containerd container runtimes requires CNI

helpers_test.go:176: Cleaning up "kubenet-20211203024159-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-20211203024159-532170

--- SKIP: TestNetworkPlugins/group/kubenet (0.94s)

–

TestNetworkPlugins/group/flannel (0.88s)

=== RUN   TestNetworkPlugins/group/flannel

net_test.go:77: flannel is not yet compatible with Docker driver: iptables v1.8.3 (legacy): Couldn't load target `CNI-x': No such file or directory

helpers_test.go:176: Cleaning up "flannel-20211203024200-532170" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p flannel-20211203024200-532170

E1203 02:42:00.940577  532170 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-containerd-12084-528713-c80793cd5dc08b1689a4be5c7f82539738da3c98/.minikube/profiles/ingress-addon-legacy-20211203021853-532170/client.crt: no such file or directory

--- SKIP: TestNetworkPlugins/group/flannel (0.88s)