Test Report: Docker_Linux

Test fail (2/284)

Order	failed test	Duration
232	TestPause/serial/PauseAgain	32.32
351	TestStartStop/group/embed-certs/serial/Pause	6.52

–

TestPause/serial/PauseAgain (32.32s)

=== RUN   TestPause/serial/PauseAgain

pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210915191040-306161 --alsologtostderr -v=5

pause_test.go:108: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p pause-20210915191040-306161 --alsologtostderr -v=5: exit status 80 (4.610152748s)

-- stdout --

	* Pausing node pause-20210915191040-306161 ...

-- /stdout --

** stderr **

	I0915 19:11:55.861377  483809 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:11:55.861590  483809 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:11:55.861599  483809 out.go:311] Setting ErrFile to fd 2...

	I0915 19:11:55.861604  483809 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:11:55.861708  483809 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:11:55.861881  483809 out.go:305] Setting JSON to false

	I0915 19:11:55.861904  483809 mustload.go:65] Loading cluster: pause-20210915191040-306161

	I0915 19:11:55.862178  483809 config.go:177] Loaded profile config "pause-20210915191040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 19:11:55.862574  483809 cli_runner.go:115] Run: docker container inspect pause-20210915191040-306161 --format={{.State.Status}}

	I0915 19:11:55.903790  483809 host.go:66] Checking if "pause-20210915191040-306161" exists ...

	I0915 19:11:55.904145  483809 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:11:55.996980  483809 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:59 SystemTime:2021-09-15 19:11:55.9467662 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddres

s:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings

:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:11:55.997482  483809 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=

true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12425/minikube-v1.23.0-1631662909-12425.iso https://github.com/kubernetes/minikube/releases/download/v1.23.0-1631662909-12425/minikube-v1.23.0-1631662909-12425.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.23.0-1631662909-12425.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu

gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:pause-20210915191040-306161 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I0915 19:11:57.382484  483809 out.go:177] * Pausing node pause-20210915191040-306161 ...

	I0915 19:11:57.382527  483809 host.go:66] Checking if "pause-20210915191040-306161" exists ...

	I0915 19:11:57.382891  483809 ssh_runner.go:152] Run: systemctl --version

	I0915 19:11:57.382947  483809 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" pause-20210915191040-306161

	I0915 19:11:57.433562  483809 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33118 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/pause-20210915191040-306161/id_rsa Username:docker}

	I0915 19:11:57.513268  483809 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:11:57.522477  483809 pause.go:50] kubelet running: true

	I0915 19:11:57.522552  483809 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet

	I0915 19:11:57.612799  483809 ssh_runner.go:152] Run: docker ps --filter status=running --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}

	I0915 19:11:57.649114  483809 docker.go:407] Pausing containers: [bba215ebb412 34c35294796d 3dcc70b67afa d15f2b587bbf 8dd7be01f740 74da63129b6f a5f849b43b1c b2b6bdeb15b9 27693cb21ee8 05fa6730f481 cd525100a832 5da3019bf389 2b95e975790b ce786a1a3e58]

	I0915 19:11:57.649224  483809 ssh_runner.go:152] Run: docker pause bba215ebb412 34c35294796d 3dcc70b67afa d15f2b587bbf 8dd7be01f740 74da63129b6f a5f849b43b1c b2b6bdeb15b9 27693cb21ee8 05fa6730f481 cd525100a832 5da3019bf389 2b95e975790b ce786a1a3e58

	I0915 19:12:00.395663  483809 ssh_runner.go:192] Completed: docker pause bba215ebb412 34c35294796d 3dcc70b67afa d15f2b587bbf 8dd7be01f740 74da63129b6f a5f849b43b1c b2b6bdeb15b9 27693cb21ee8 05fa6730f481 cd525100a832 5da3019bf389 2b95e975790b ce786a1a3e58: (2.746407978s)

	I0915 19:12:00.398966  483809 out.go:177]

	W0915 19:12:00.399171  483809 out.go:242] X Exiting due to GUEST_PAUSE: docker: docker pause bba215ebb412 34c35294796d 3dcc70b67afa d15f2b587bbf 8dd7be01f740 74da63129b6f a5f849b43b1c b2b6bdeb15b9 27693cb21ee8 05fa6730f481 cd525100a832 5da3019bf389 2b95e975790b ce786a1a3e58: Process exited with status 1

	stdout:

	stderr:

	Error response from daemon: Cannot pause container 05fa6730f48169d2ac729d988cd9323576ee6eec8a609c586992b637f8c4d022: OCI runtime pause failed: unable to freeze: unknown

	X Exiting due to GUEST_PAUSE: docker: docker pause bba215ebb412 34c35294796d 3dcc70b67afa d15f2b587bbf 8dd7be01f740 74da63129b6f a5f849b43b1c b2b6bdeb15b9 27693cb21ee8 05fa6730f481 cd525100a832 5da3019bf389 2b95e975790b ce786a1a3e58: Process exited with status 1

	stdout:

	stderr:

	Error response from daemon: Cannot pause container 05fa6730f48169d2ac729d988cd9323576ee6eec8a609c586992b637f8c4d022: OCI runtime pause failed: unable to freeze: unknown

	W0915 19:12:00.399190  483809 out.go:242] *

	W0915 19:12:00.406063  483809 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0915 19:12:00.407611  483809 out.go:177]

** /stderr **

pause_test.go:110: failed to pause minikube with args: "out/minikube-linux-amd64 pause -p pause-20210915191040-306161 --alsologtostderr -v=5" : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191040-306161

helpers_test.go:236: (dbg) docker inspect pause-20210915191040-306161:

-- stdout --

	        "Id": "bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061",

	        "Created": "2021-09-15T19:10:42.551354157Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 459889,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-09-15T19:10:43.169524869Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",

	        "ResolvConfPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/hostname",

	        "HostsPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/hosts",

	        "LogPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061-json.log",

	        "Name": "/pause-20210915191040-306161",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20210915191040-306161:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20210915191040-306161",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e-init/diff:/var/lib/docker/overlay2/42af7561be1bbb04e60d5898b29ceee8cccacce1c1e5ac5a5471bd2c2eb199c1/diff:/var/lib/docker/overlay2/751fc28b4872d1d49285c85a1cc36b03020834feb891b324f4934fc7bbb2a6ad/diff:/var/lib/docker/overlay2/0ecc58bf735cb0b519ef22a62daf0e530d708564e0b5e2a32c0d2dfbf82c31f1/diff:/var/lib/docker/overlay2/40f6c03795cd703755126d403a243ddfa2b5a61c04ba64a54188be2d675512f0/diff:/var/lib/docker/overlay2/c1ed82aa36dccda427851e6e631dda57f4ea197ec647ed726ad163b6ab37743f/diff:/var/lib/docker/overlay2/80d741d1e18c6360d99304165056959acb58e58f7c7d3b65d8d53565555b4030/diff:/var/lib/docker/overlay2/447eff9d25dbd151310c8d31d34423f404bc92869252861a8515d52575670208/diff:/var/lib/docker/overlay2/c0772139dfb4023aacb541a406a5e5d1697bd07fb74faf19f0f70c0378a6a0aa/diff:/var/lib/docker/overlay2/b6bb35ea8704143c911f2f148b8a83fb1595e56bdb785ad83f7f5b0ba255050b/diff:/var/lib/docker/overlay2/77cfc0

f9841fd241edda977799472f43ff62c670f7f0dc94936630ed52e1b91e/diff:/var/lib/docker/overlay2/47450527f7ce6a152d348dbe5dac4026cc11f3f715cf7e7b7ea7e797df3f5cf4/diff:/var/lib/docker/overlay2/5ea3e2569f810895df6596566930f3068e5c5d42831d6bda8de83d19c1185d3f/diff:/var/lib/docker/overlay2/d116c54fdfbaac2c30c98b1317c22640c46f07f3f9924da3e450e7cc3f026f3b/diff:/var/lib/docker/overlay2/4f1d2222e5e679ccc39dcf8be0e0caad5028cf91c0cc32b4025b79da0530cf79/diff:/var/lib/docker/overlay2/d395fbc24d899f00e3584b6298d4b2d46f9c834636fa54bf82aec3d8bf7aa1e4/diff:/var/lib/docker/overlay2/a294a18c3929a26e58691a4f489d1d4ed51d12a1c252dc68fdee0b9bddededd1/diff:/var/lib/docker/overlay2/8bba47552514f0de9059dcaf0fac98e702505d70e78a52d0394a82f5fc85fa37/diff:/var/lib/docker/overlay2/020c4987317db46a4f9cdc01cf984f014ead8756b3e1c340fb8f181a80339c1c/diff:/var/lib/docker/overlay2/a9def08cecacaa841f943f37f2b4027d2b8c9c6b2a0e55d4844d2c257eddd0e6/diff:/var/lib/docker/overlay2/17ef9dd7c4c56b129b7bcdf2629184e963776cba2a5484bd18ca3102b68d02cc/diff:/var/lib/d

ocker/overlay2/8d91d9e3464303a35c2d8a3a3f93f0ab30cd9fe6fa28c942ddc92769cf590ac9/diff:/var/lib/docker/overlay2/9830b73f3f06b9fc4f470e3b1dc16b8a3299272056c5131a298e6bb42a083941/diff:/var/lib/docker/overlay2/ea9d596d994ea5dfd5a26427720cb2e8361d797aa279267428df94c19a9d7c44/diff:/var/lib/docker/overlay2/2e1466e09da2855871ebe76fbcffcb15fd134652525feb0105fe152a084d210e/diff:/var/lib/docker/overlay2/9bdc54e7df3f3e5c2597a98b2737c550e37e1f78d16859fb6518d8b440ca0b08/diff:/var/lib/docker/overlay2/5037f238f4a3fe4dab6cd163114a4e1ff421eac25c08e1692759c11df7b3ee16/diff:/var/lib/docker/overlay2/873666dc974cc73345c5bdf7408c32b17137d25cc199834ebd8660d05c9481e2/diff:/var/lib/docker/overlay2/139b02d97d4069f11d6bc3503baa4785c0a78b8bd7bc9cb27acaf894f3107aa9/diff:/var/lib/docker/overlay2/6e6fd6abdb501264791d7c049ecc9089ab221a7aa6f4cbb745874fefd93cf871/diff:/var/lib/docker/overlay2/11575ed178ccca3cb09dfeb7628b08e11e6a3357f3659c2890a288ce9f2ba782/diff:/var/lib/docker/overlay2/bb3435980235e05ccce2d74ef847a0acd46c4edf0d38983388b271aa9dd

b6053/diff:/var/lib/docker/overlay2/0e3e4464369c9a27193d7ad87e67c5485363aeabca8fcbc6855eab5789e4c2a5/diff:/var/lib/docker/overlay2/41e71fdf4be3041a17553878254d63ea1c8c4063994bf2725203012ee9dd93c5/diff:/var/lib/docker/overlay2/76ee62595a4ab520c3233836c68c0bc0297b3907fff6db1b659f16f4325b8d3c/diff:/var/lib/docker/overlay2/dc211f5ed531b1debbcdd38dd7129b846d5e959af10f3144da2541b5c6f0233b/diff:/var/lib/docker/overlay2/6822a79442f86fb63c1067f542f9f6ce9288d3cec3ed6330fce4a6e3f48db77e/diff:/var/lib/docker/overlay2/757fc4ce96317e0c241e2344c927a20f4844398da422284baf7de7aebb6f828f/diff:/var/lib/docker/overlay2/3672ef17e397e206ae409a53d2bca46c162142ff01c54c787ba59f0bf2dad58a/diff:/var/lib/docker/overlay2/e04f51cc901a2cc97f893a3d4c6ebb453df442a6d57974d1b702d6ad1efab159/diff",

	                "MergedDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "pause-20210915191040-306161",

	                "Source": "/var/lib/docker/volumes/pause-20210915191040-306161/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "pause-20210915191040-306161",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20210915191040-306161",

	                "name.minikube.sigs.k8s.io": "pause-20210915191040-306161",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "df07212579862d4f5ae99ffb739ae3c99da6a0412ff03dd0d6816a60189e779d",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33118"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33117"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33112"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33116"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33114"

},

	            "SandboxKey": "/var/run/docker/netns/df0721257986",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20210915191040-306161": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "bca902ad6107"

],

	                    "NetworkID": "515ea92b2bf138022bfb99d0055b7e5e76b1d54cb7cfb53912aad56a462f4219",

	                    "EndpointID": "a897f77a4ed3bef902f3cd13240fca7c0c0e799541ca81af9ad32dd3573eec4d",

	                    "Gateway": "192.168.58.1",

	                    "IPAddress": "192.168.58.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:3a:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191040-306161 -n pause-20210915191040-306161

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191040-306161 -n pause-20210915191040-306161: exit status 2 (641.906414ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191040-306161 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 -p pause-20210915191040-306161 logs -n 25: exit status 110 (13.276454511s)

-- stdout --

	* ==> Audit <==

	* |------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	|  Command   |                    Args                    |                  Profile                   |   User   | Version |          Start Time           |           End Time            |

	|------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	| delete     | -p                                         | multinode-20210915185040-306161-m03        | jenkins  | v1.23.0 | Wed, 15 Sep 2021 18:56:29 UTC | Wed, 15 Sep 2021 18:56:32 UTC |

	|            | multinode-20210915185040-306161-m03        |                                            |          |         |                               |                               |

	| delete     | -p                                         | multinode-20210915185040-306161            | jenkins  | v1.23.0 | Wed, 15 Sep 2021 18:56:32 UTC | Wed, 15 Sep 2021 18:56:37 UTC |

	|            | multinode-20210915185040-306161            |                                            |          |         |                               |                               |

	| start      | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:06:19 UTC | Wed, 15 Sep 2021 19:07:32 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr            |                                            |          |         |                               |                               |

	|            | --wait=true --preload=false                |                                            |          |         |                               |                               |

	|            | --driver=docker                            |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	|            | --kubernetes-version=v1.17.0               |                                            |          |         |                               |                               |

	| ssh        | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:07:32 UTC | Wed, 15 Sep 2021 19:07:35 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | -- docker pull busybox                     |                                            |          |         |                               |                               |

	| start      | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:07:35 UTC | Wed, 15 Sep 2021 19:08:08 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr            |                                            |          |         |                               |                               |

	|            | -v=1 --wait=true --driver=docker           |                                            |          |         |                               |                               |

	|            |  --container-runtime=docker                |                                            |          |         |                               |                               |

	|            | --kubernetes-version=v1.17.3               |                                            |          |         |                               |                               |

	| ssh        | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:08 UTC | Wed, 15 Sep 2021 19:08:09 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | -- docker images                           |                                            |          |         |                               |                               |

	| delete     | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:09 UTC | Wed, 15 Sep 2021 19:08:14 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	| start      | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:14 UTC | Wed, 15 Sep 2021 19:08:36 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --memory=2048 --driver=docker              |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| stop       | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:36 UTC | Wed, 15 Sep 2021 19:08:36 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --cancel-scheduled                         |                                            |          |         |                               |                               |

	| stop       | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:54 UTC | Wed, 15 Sep 2021 19:09:10 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --schedule 5s                              |                                            |          |         |                               |                               |

	| delete     | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:09:19 UTC | Wed, 15 Sep 2021 19:09:21 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	| start      | -p                                         | skaffold-20210915190921-306161             | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:09:22 UTC | Wed, 15 Sep 2021 19:09:43 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	|            | --memory=2600 --driver=docker              |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| docker-env | --shell none -p                            | skaffold-20210915190921-306161             | skaffold | v1.23.0 | Wed, 15 Sep 2021 19:09:44 UTC | Wed, 15 Sep 2021 19:09:44 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	|            | --user=skaffold                            |                                            |          |         |                               |                               |

	| delete     | -p                                         | skaffold-20210915190921-306161             | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:27 UTC | Wed, 15 Sep 2021 19:10:30 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	| delete     | -p                                         | insufficient-storage-20210915191030-306161 | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:38 UTC | Wed, 15 Sep 2021 19:10:40 UTC |

	|            | insufficient-storage-20210915191030-306161 |                                            |          |         |                               |                               |

	| delete     | -p                                         | flannel-20210915191040-306161              | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:10:40 UTC |

	|            | flannel-20210915191040-306161              |                                            |          |         |                               |                               |

	| start      | -p                                         | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:27 UTC |

	|            | force-systemd-flag-20210915191040-306161   |                                            |          |         |                               |                               |

	|            | --memory=2048 --force-systemd              |                                            |          |         |                               |                               |

	|            | --alsologtostderr -v=5 --driver=docker     |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| -p         | force-systemd-flag-20210915191040-306161   | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:27 UTC | Wed, 15 Sep 2021 19:11:28 UTC |

	|            | ssh docker info --format                   |                                            |          |         |                               |                               |

	|            | {{.CgroupDriver}}                          |                                            |          |         |                               |                               |

	| delete     | -p                                         | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:28 UTC | Wed, 15 Sep 2021 19:11:30 UTC |

	|            | force-systemd-flag-20210915191040-306161   |                                            |          |         |                               |                               |

	| start      | -p                                         | offline-docker-20210915191040-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:42 UTC |

	|            | offline-docker-20210915191040-306161       |                                            |          |         |                               |                               |

	|            | --alsologtostderr -v=1 --memory=2048       |                                            |          |         |                               |                               |

	|            | --wait=true --driver=docker                |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| start      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:42 UTC |

	|            | --memory=2048                              |                                            |          |         |                               |                               |

	|            | --install-addons=false                     |                                            |          |         |                               |                               |

	|            | --wait=all --driver=docker                 |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| delete     | -p                                         | offline-docker-20210915191040-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:42 UTC | Wed, 15 Sep 2021 19:11:50 UTC |

	|            | offline-docker-20210915191040-306161       |                                            |          |         |                               |                               |

	| start      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:43 UTC | Wed, 15 Sep 2021 19:11:52 UTC |

	|            | --alsologtostderr                          |                                            |          |         |                               |                               |

	|            | -v=1 --driver=docker                       |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| pause      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:52 UTC | Wed, 15 Sep 2021 19:11:52 UTC |

	|            | --alsologtostderr -v=5                     |                                            |          |         |                               |                               |

	| unpause    | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:53 UTC | Wed, 15 Sep 2021 19:11:55 UTC |

	|            | --alsologtostderr -v=5                     |                                            |          |         |                               |                               |

	|------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 19:11:52

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 19:11:52.646190  482400 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:11:52.646289  482400 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:11:52.646298  482400 out.go:311] Setting ErrFile to fd 2...

	I0915 19:11:52.646304  482400 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:11:52.646451  482400 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:11:52.646723  482400 out.go:305] Setting JSON to false

	I0915 19:11:52.709402  482400 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":17490,"bootTime":1631715623,"procs":261,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 19:11:52.709580  482400 start.go:121] virtualization: kvm guest

	I0915 19:11:52.712706  482400 out.go:177] * [stopped-upgrade-20210915191040-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	I0915 19:11:52.724951  482400 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:11:52.712947  482400 notify.go:169] Checking for updates...

	I0915 19:11:52.729893  482400 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 19:11:52.732520  482400 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 19:11:52.736050  482400 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 19:11:52.736631  482400 config.go:177] Loaded profile config "stopped-upgrade-20210915191040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0915 19:11:52.736653  482400 start_flags.go:561] config upgrade: KicBaseImage=gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56

	I0915 19:11:52.742215  482400 out.go:177] * Kubernetes 1.22.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.1

	I0915 19:11:52.742288  482400 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 19:11:52.817439  482400 docker.go:132] docker version: linux-19.03.15

	I0915 19:11:52.817558  482400 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:11:52.947450  482400 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:47 SystemTime:2021-09-15 19:11:52.876518695 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:11:52.947559  482400 docker.go:237] overlay module found

	I0915 19:11:52.949261  482400 out.go:177] * Using the docker driver based on existing profile

	I0915 19:11:52.949289  482400 start.go:278] selected driver: docker

	I0915 19:11:52.949296  482400 start.go:751] validating driver "docker" against &{Name:stopped-upgrade-20210915191040-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20210915191040-306161 Namespace: APIServe

rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:172.17.0.5 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[] StartHostTimeout:0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:11:52.949383  482400 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 19:11:52.949423  482400 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:11:52.949440  482400 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:11:52.951286  482400 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:11:52.952197  482400 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:11:53.065988  482400 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:47 SystemTime:2021-09-15 19:11:52.997961998 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W0915 19:11:53.066165  482400 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:11:53.066201  482400 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:11:53.068504  482400 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:11:53.068615  482400 cni.go:93] Creating CNI manager for ""

	I0915 19:11:53.068639  482400 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:11:53.068650  482400 start_flags.go:278] config:

	{Name:stopped-upgrade-20210915191040-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.18.0 ClusterName:stopped-upgrade-20210915191040-306161 Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta

inerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.244.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:172.17.0.5 Port:8443 KubernetesVersion:v1.18.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[] StartHostTimeout:0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:11:53.070689  482400 out.go:177] * Starting control plane node stopped-upgrade-20210915191040-306161 in cluster stopped-upgrade-20210915191040-306161

	I0915 19:11:53.070719  482400 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 19:11:53.072376  482400 out.go:177] * Pulling base image ...

	I0915 19:11:53.072419  482400 preload.go:131] Checking if preload exists for k8s version v1.18.0 and runtime docker

	I0915 19:11:53.072526  482400 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	W0915 19:11:53.144041  482400 preload.go:114] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.18.0-docker-overlay2-amd64.tar.lz4 status code: 404

	I0915 19:11:53.144225  482400 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/stopped-upgrade-20210915191040-306161/config.json ...

	I0915 19:11:53.144592  482400 cache.go:108] acquiring lock: {Name:mk6b9e7d3773167a64e148aca319303ee031f9ff Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.144748  482400 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 exists

	I0915 19:11:53.144767  482400 cache.go:97] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.4" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4" took 184.439µs

	I0915 19:11:53.144781  482400 cache.go:81] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.4 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 succeeded

	I0915 19:11:53.144760  482400 cache.go:108] acquiring lock: {Name:mk585c58d0101944c482cec7adaff8d8f7ec59d3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.144796  482400 cache.go:108] acquiring lock: {Name:mk403ba4c0fcf40250a1e4cabb5f46b09336815f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.144827  482400 cache.go:108] acquiring lock: {Name:mkeae6c789ec45d617b2ccf67c0c9f46df3527b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.144889  482400 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.4.3-0 exists

	I0915 19:11:53.144906  482400 cache.go:97] cache image "k8s.gcr.io/etcd:3.4.3-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.4.3-0" took 112.731µs

	I0915 19:11:53.144951  482400 cache.go:81] save to tar file k8s.gcr.io/etcd:3.4.3-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/etcd_3.4.3-0 succeeded

	I0915 19:11:53.144973  482400 image.go:135] retrieving image: k8s.gcr.io/coredns:1.6.7

	I0915 19:11:53.144969  482400 cache.go:108] acquiring lock: {Name:mk59f9a64799ea42370cf9937feecb10f3c510bc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145077  482400 image.go:135] retrieving image: k8s.gcr.io/kube-apiserver:v1.18.0

	I0915 19:11:53.145131  482400 cache.go:108] acquiring lock: {Name:mk86067ad82c4611ff746f3e055c785e01961386 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145184  482400 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I0915 19:11:53.145198  482400 cache.go:97] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" took 70.724µs

	I0915 19:11:53.145209  482400 cache.go:81] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I0915 19:11:53.145225  482400 cache.go:108] acquiring lock: {Name:mk6305aaf40bbdef6a3d1d54eebacee91a81701a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145270  482400 cache.go:116] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 exists

	I0915 19:11:53.145261  482400 cache.go:108] acquiring lock: {Name:mk4da25d12084ed57de36e92e2221428939fc275 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145280  482400 cache.go:97] cache image "docker.io/kubernetesui/dashboard:v2.1.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0" took 57.293µs

	I0915 19:11:53.145290  482400 cache.go:81] save to tar file docker.io/kubernetesui/dashboard:v2.1.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 succeeded

	I0915 19:11:53.145377  482400 image.go:135] retrieving image: k8s.gcr.io/kube-controller-manager:v1.18.0

	I0915 19:11:53.145419  482400 image.go:135] retrieving image: k8s.gcr.io/pause:3.2

	I0915 19:11:53.145498  482400 cache.go:108] acquiring lock: {Name:mkbc6a4dde5b13a178e2ded1914cdd64fd4b3072 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145573  482400 image.go:135] retrieving image: k8s.gcr.io/kube-scheduler:v1.18.0

	I0915 19:11:53.145640  482400 cache.go:108] acquiring lock: {Name:mk515309a95102e653769009e406a4e6cf62bd44 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.145714  482400 image.go:135] retrieving image: k8s.gcr.io/kube-proxy:v1.18.0

	I0915 19:11:53.146525  482400 image.go:181] daemon lookup for k8s.gcr.io/kube-apiserver:v1.18.0: Error response from daemon: reference does not exist

	I0915 19:11:53.146596  482400 image.go:181] daemon lookup for k8s.gcr.io/coredns:1.6.7: Error response from daemon: reference does not exist

	I0915 19:11:53.146599  482400 image.go:181] daemon lookup for k8s.gcr.io/kube-controller-manager:v1.18.0: Error response from daemon: reference does not exist

	I0915 19:11:53.146817  482400 image.go:181] daemon lookup for k8s.gcr.io/kube-proxy:v1.18.0: Error response from daemon: reference does not exist

	I0915 19:11:53.146879  482400 image.go:181] daemon lookup for k8s.gcr.io/kube-scheduler:v1.18.0: Error response from daemon: reference does not exist

	I0915 19:11:53.156270  482400 image.go:177] found k8s.gcr.io/pause:3.2 locally: &{UncompressedImageCore:0xc00068a360 lock:{state:0 sema:0} manifest:<nil>}

	I0915 19:11:53.156310  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2

	I0915 19:11:53.201237  482400 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 19:11:53.201272  482400 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 19:11:53.201285  482400 cache.go:206] Successfully downloaded all kic artifacts

	I0915 19:11:53.201324  482400 start.go:313] acquiring machines lock for stopped-upgrade-20210915191040-306161: {Name:mk770135214cd09dfecc39b319fa3976c796555c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:11:53.201452  482400 start.go:317] acquired machines lock for "stopped-upgrade-20210915191040-306161" in 108.064µs

	I0915 19:11:53.201473  482400 start.go:93] Skipping create...Using existing machine configuration

	I0915 19:11:53.201495  482400 fix.go:55] fixHost starting: m01

	I0915 19:11:53.201785  482400 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20210915191040-306161 --format={{.State.Status}}

	I0915 19:11:53.211534  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists

	I0915 19:11:53.211588  482400 cache.go:97] cache image "k8s.gcr.io/pause:3.2" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 66.845869ms

	I0915 19:11:53.211607  482400 cache.go:81] save to tar file k8s.gcr.io/pause:3.2 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded

	I0915 19:11:53.253809  482400 fix.go:108] recreateIfNeeded on stopped-upgrade-20210915191040-306161: state=Stopped err=<nil>

	W0915 19:11:53.253847  482400 fix.go:134] unexpected machine state, will restart: <nil>

	I0915 19:11:49.488824  474180 out.go:204]   - Booting up control plane ...

	I0915 19:11:53.257125  482400 out.go:177] * Restarting existing docker container for "stopped-upgrade-20210915191040-306161" ...

	I0915 19:11:53.257211  482400 cli_runner.go:115] Run: docker start stopped-upgrade-20210915191040-306161

	I0915 19:11:53.496605  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.18.0

	I0915 19:11:53.500560  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.6.7

	I0915 19:11:53.535700  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.18.0

	I0915 19:11:53.536284  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.18.0

	I0915 19:11:53.557757  482400 cache.go:162] opening:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.18.0

	I0915 19:11:54.128303  482400 cli_runner.go:115] Run: docker container inspect stopped-upgrade-20210915191040-306161 --format={{.State.Status}}

	I0915 19:11:54.130639  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.6.7 exists

	I0915 19:11:54.130690  482400 cache.go:97] cache image "k8s.gcr.io/coredns:1.6.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.6.7" took 985.862151ms

	I0915 19:11:54.130710  482400 cache.go:81] save to tar file k8s.gcr.io/coredns:1.6.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/coredns_1.6.7 succeeded

	I0915 19:11:54.203935  482400 kic.go:420] container "stopped-upgrade-20210915191040-306161" state is running.

	I0915 19:11:54.204348  482400 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" stopped-upgrade-20210915191040-306161

	I0915 19:11:54.231636  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.18.0 exists

	I0915 19:11:54.231688  482400 cache.go:97] cache image "k8s.gcr.io/kube-scheduler:v1.18.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.18.0" took 1.086191074s

	I0915 19:11:54.231705  482400 cache.go:81] save to tar file k8s.gcr.io/kube-scheduler:v1.18.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.18.0 succeeded

	I0915 19:11:54.259842  482400 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/stopped-upgrade-20210915191040-306161/config.json ...

	I0915 19:11:54.260071  482400 machine.go:88] provisioning docker machine ...

	I0915 19:11:54.260096  482400 ubuntu.go:169] provisioning hostname "stopped-upgrade-20210915191040-306161"

	I0915 19:11:54.260150  482400 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" stopped-upgrade-20210915191040-306161

	I0915 19:11:54.325806  482400 main.go:130] libmachine: Using SSH client type: native

	I0915 19:11:54.326024  482400 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33139 <nil> <nil>}

	I0915 19:11:54.326047  482400 main.go:130] libmachine: About to run SSH command:

	sudo hostname stopped-upgrade-20210915191040-306161 && echo "stopped-upgrade-20210915191040-306161" | sudo tee /etc/hostname

	I0915 19:11:54.326604  482400 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42638->127.0.0.1:33139: read: connection reset by peer

	I0915 19:11:54.552996  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.18.0 exists

	I0915 19:11:54.553044  482400 cache.go:97] cache image "k8s.gcr.io/kube-apiserver:v1.18.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.18.0" took 1.408077067s

	I0915 19:11:54.553063  482400 cache.go:81] save to tar file k8s.gcr.io/kube-apiserver:v1.18.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.18.0 succeeded

	I0915 19:11:54.595267  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.18.0 exists

	I0915 19:11:54.595323  482400 cache.go:97] cache image "k8s.gcr.io/kube-controller-manager:v1.18.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.18.0" took 1.450067048s

	I0915 19:11:54.595341  482400 cache.go:81] save to tar file k8s.gcr.io/kube-controller-manager:v1.18.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.18.0 succeeded

	I0915 19:11:55.264209  482400 cache.go:157] /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.18.0 exists

	I0915 19:11:55.264257  482400 cache.go:97] cache image "k8s.gcr.io/kube-proxy:v1.18.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.18.0" took 2.118618441s

	I0915 19:11:55.264270  482400 cache.go:81] save to tar file k8s.gcr.io/kube-proxy:v1.18.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.18.0 succeeded

	I0915 19:11:55.264296  482400 cache.go:88] Successfully saved all images to host disk.

	I0915 19:11:57.328827  482400 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:42718->127.0.0.1:33139: read: connection reset by peer

	* ==> Docker <==

	* -- Logs begin at Wed 2021-09-15 19:10:43 UTC, end at Wed 2021-09-15 19:12:01 UTC. --

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.748712844Z" level=info msg="Starting up"

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750726725Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750759815Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750780766Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750789481Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752119284Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752145616Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752162703Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752175184Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.785563417Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.554871470Z" level=warning msg="Your kernel does not support swap memory limit"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.554906136Z" level=warning msg="Your kernel does not support CPU realtime scheduler"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.555074626Z" level=info msg="Loading containers: start."

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.683507911Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.723475583Z" level=info msg="Loading containers: done."

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.769826862Z" level=info msg="Docker daemon" commit=75249d8 graphdriver(s)=overlay2 version=20.10.8

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.769898162Z" level=info msg="Daemon has completed initialization"

	Sep 15 19:11:09 pause-20210915191040-306161 systemd[1]: Started Docker Application Container Engine.

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.795475313Z" level=info msg="API listen on [::]:2376"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.801062171Z" level=info msg="API listen on /var/run/docker.sock"

	Sep 15 19:11:39 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:39.846858888Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:11:39 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:39.912853399Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:11:46 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:46.010009521Z" level=info msg="ignoring event" container=911ed5b73e6164b00cf21e7a002849689816a87dee31cfd456db3785edf19049 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:11:49 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:49.461607020Z" level=info msg="ignoring event" container=6b92c509ec02896125a066229c0d5f6d8bfe46bc786dae6c3721a2946143e297 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:11:57 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:57.959519722Z" level=error msg="Handler for POST /v1.41/containers/05fa6730f481/pause returned error: Cannot pause container 05fa6730f48169d2ac729d988cd9323576ee6eec8a609c586992b637f8c4d022: OCI runtime pause failed: unable to freeze: unknown"

	* ==> container status <==

	* time="2021-09-15T19:12:03Z" level=fatal msg="connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"

	CONTAINER ID   IMAGE                  COMMAND                  CREATED          STATUS                      PORTS     NAMES

	bba215ebb412   6e38f40d628d           "/storage-provisioner"   12 seconds ago   Up 12 seconds (Paused)                k8s_storage-provisioner_storage-provisioner_kube-system_6ec6737e-98cf-42bd-a911-9c89db377921_0

	34c35294796d   k8s.gcr.io/pause:3.5   "/pause"                 12 seconds ago   Up 12 seconds (Paused)                k8s_POD_storage-provisioner_kube-system_6ec6737e-98cf-42bd-a911-9c89db377921_0

	3dcc70b67afa   8d147537fb7d           "/coredns -conf /etc…"   24 seconds ago   Up 23 seconds (Paused)                k8s_coredns_coredns-78fcd69978-wgdfl_kube-system_1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83_0

	d15f2b587bbf   36c4ebbc9d97           "/usr/local/bin/kube…"   25 seconds ago   Up 24 seconds (Paused)                k8s_kube-proxy_kube-proxy-m4kfv_kube-system_136bb615-a920-412f-b4ce-fdeeb75acfcb_0

	6b92c509ec02   k8s.gcr.io/pause:3.5   "/pause"                 25 seconds ago   Exited (0) 14 seconds ago             k8s_POD_coredns-78fcd69978-fvrsb_kube-system_595bf515-bff7-4331-9552-89a5ba57ca6b_0

	8dd7be01f740   k8s.gcr.io/pause:3.5   "/pause"                 25 seconds ago   Up 24 seconds (Paused)                k8s_POD_coredns-78fcd69978-wgdfl_kube-system_1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83_0

	74da63129b6f   k8s.gcr.io/pause:3.5   "/pause"                 25 seconds ago   Up 25 seconds (Paused)                k8s_POD_kube-proxy-m4kfv_kube-system_136bb615-a920-412f-b4ce-fdeeb75acfcb_0

	a5f849b43b1c   6e002eb89a88           "kube-controller-man…"   46 seconds ago   Up 45 seconds (Paused)                k8s_kube-controller-manager_kube-controller-manager-pause-20210915191040-306161_kube-system_7de1da23176b119dfecc95ecb61dd307_0

	b2b6bdeb15b9   aca5ededae9c           "kube-scheduler --au…"   46 seconds ago   Up 45 seconds (Paused)                k8s_kube-scheduler_kube-scheduler-pause-20210915191040-306161_kube-system_1a018d46efe067cf543c61ee8873be83_0

	27693cb21ee8   f30469a2491a           "kube-apiserver --ad…"   46 seconds ago   Up 45 seconds (Paused)                k8s_kube-apiserver_kube-apiserver-pause-20210915191040-306161_kube-system_b43c2d1987c2753ab3b743454432ec65_0

	05fa6730f481   004811815584           "etcd --advertise-cl…"   46 seconds ago   Up 45 seconds                         k8s_etcd_etcd-pause-20210915191040-306161_kube-system_87e207cf7ed458dc963e57311bee91a6_0

	cd525100a832   k8s.gcr.io/pause:3.5   "/pause"                 46 seconds ago   Up 46 seconds (Paused)                k8s_POD_kube-scheduler-pause-20210915191040-306161_kube-system_1a018d46efe067cf543c61ee8873be83_0

	5da3019bf389   k8s.gcr.io/pause:3.5   "/pause"                 46 seconds ago   Up 46 seconds (Paused)                k8s_POD_kube-controller-manager-pause-20210915191040-306161_kube-system_7de1da23176b119dfecc95ecb61dd307_0

	2b95e975790b   k8s.gcr.io/pause:3.5   "/pause"                 46 seconds ago   Up 46 seconds (Paused)                k8s_POD_kube-apiserver-pause-20210915191040-306161_kube-system_b43c2d1987c2753ab3b743454432ec65_0

	ce786a1a3e58   k8s.gcr.io/pause:3.5   "/pause"                 46 seconds ago   Up 46 seconds (Paused)                k8s_POD_etcd-pause-20210915191040-306161_kube-system_87e207cf7ed458dc963e57311bee91a6_0

	* ==> coredns [3dcc70b67afa] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* ==> dmesg <==

	* [ +17.772866] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 18:54] cgroup: cgroup2: unknown option "nsdelegate"

	[  +6.702807] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev veth8705e930

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 12 69 6e a5 f0 15 08 06        .......in.....

	[Sep15 18:55] cgroup: cgroup2: unknown option "nsdelegate"

	[ +16.873151] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethfb23be6d

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa c8 da 40 c8 b6 08 06        .........@....

	[  +1.199924] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev veth7db36ce7

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff ce 61 5a cc 64 d4 08 06        .......aZ.d...

	[ +13.998812] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 18:56] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethd9ced9de

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 76 3d db ca 7d c7 08 06        ......v=..}...

	[  +4.397740] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:06] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:08] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:09] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:10] cgroup: cgroup2: unknown option "nsdelegate"

	[ +10.362374] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.511989] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.528368] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:11] cgroup: cgroup2: unknown option "nsdelegate"

	[ +26.565621] cgroup: cgroup2: unknown option "nsdelegate"

	[ +24.216665] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.000652] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:12] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [05fa6730f481] <==

	* {"level":"warn","ts":"2021-09-15T19:11:57.608Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"205.990111ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/etcd-pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[334900010] range","detail":"{range_begin:/registry/pods/kube-system/etcd-pause-20210915191040-306161; range_end:; }","duration":"206.246114ms","start":"2021-09-15T19:11:57.402Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[334900010] 'agreement among raft nodes before linearized reading'  (duration: 205.986899ms)"],"step_count":1}

	{"level":"warn","ts":"2021-09-15T19:11:57.608Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"209.587999ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[1188001142] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-pause-20210915191040-306161; range_end:; }","duration":"209.88735ms","start":"2021-09-15T19:11:57.399Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[1188001142] 'agreement among raft nodes before linearized reading'  (duration: 209.585643ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.609Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"205.22734ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[1804048700] range","detail":"{range_begin:/registry/minions/pause-20210915191040-306161; range_end:; }","duration":"205.267382ms","start":"2021-09-15T19:11:57.404Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[1804048700] 'agreement among raft nodes before linearized reading'  (duration: 205.22617ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.609Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"211.41271ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-proxy-m4kfv\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[72393194] range","detail":"{range_begin:/registry/pods/kube-system/kube-proxy-m4kfv; range_end:; }","duration":"211.45198ms","start":"2021-09-15T19:11:57.398Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[72393194] 'agreement among raft nodes before linearized reading'  (duration: 211.424329ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.899Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:58.400Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:58.900Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:59.401Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:59.902Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:12:00.385Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"2.975183355s","expected-duration":"1s"}

	{"level":"info","ts":"2021-09-15T19:12:00.386Z","caller":"traceutil/trace.go:171","msg":"trace[649689859] transaction","detail":"{read_only:false; response_revision:499; number_of_response:1; }","duration":"2.985361187s","start":"2021-09-15T19:11:57.401Z","end":"2021-09-15T19:12:00.386Z","steps":["trace[649689859] 'process raft request'  (duration: 2.985215108s)"],"step_count":1}

	{"level":"warn","ts":"2021-09-15T19:12:00.386Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:11:57.401Z","time spent":"2.985466989s","remote":"127.0.0.1:49570","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:491 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}

	{"level":"info","ts":"2021-09-15T19:12:00.387Z","caller":"traceutil/trace.go:171","msg":"trace[1681736244] linearizableReadLoop","detail":"{readStateIndex:521; appliedIndex:515; }","duration":"2.988488142s","start":"2021-09-15T19:11:57.398Z","end":"2021-09-15T19:12:00.386Z","steps":["trace[1681736244] 'read index received'  (duration: 2.986831523s)","trace[1681736244] 'applied index is now lower than readState.Index'  (duration: 1.655849ms)"],"step_count":2}

	* ==> kernel <==

	*  19:12:14 up  4:51,  0 users,  load average: 6.71, 3.23, 1.78

	Linux pause-20210915191040-306161 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [27693cb21ee8] <==

	* I0915 19:11:57.612216       1 trace.go:205] Trace[90908807]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:4e96f995-20f4-46d9-9e91-48a3165f9dbc,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:54.869) (total time: 2742ms):

	Trace[90908807]: [2.742216687s] [2.742216687s] END

	E0915 19:11:57.612302       1 timeout.go:135] post-timeout activity - time-elapsed: 3.47907ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E0915 19:11:57.613288       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.618821       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.620020       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0915 19:11:57.621075       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.624382       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.634372       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.635509       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.636607       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.637770       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.638916       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.640203       1 timeout.go:135] post-timeout activity - time-elapsed: 31.371334ms, POST "/api/v1/namespaces/default/events" result: <nil>

	I0915 19:11:57.641167       1 trace.go:205] Trace[1143014761]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:bb3c2312-8930-436b-870a-91869178ba4a,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:54.844) (total time: 2796ms):

	Trace[1143014761]: [2.796835127s] [2.796835127s] END

	E0915 19:11:57.641259       1 timeout.go:135] post-timeout activity - time-elapsed: 32.032015ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E0915 19:11:57.642472       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I0915 19:11:57.643605       1 trace.go:205] Trace[137628608]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:0e2bebaf-ce34-4283-89d7-b9b51c771f61,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:56.470) (total time: 1173ms):

	Trace[137628608]: [1.173147509s] [1.173147509s] END

	E0915 19:11:57.643697       1 timeout.go:135] post-timeout activity - time-elapsed: 34.342272ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token" result: <nil>

	I0915 19:11:57.644701       1 trace.go:205] Trace[840664150]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/kube-proxy/token,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:8be84463-647a-4c66-8e45-50f775e917ef,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:56.069) (total time: 1574ms):

	Trace[840664150]: [1.574755248s] [1.574755248s] END

	E0915 19:11:57.644778       1 timeout.go:135] post-timeout activity - time-elapsed: 35.255523ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/kube-proxy/token" result: <nil>

	E0915 19:11:57.648324       1 timeout.go:135] post-timeout activity - time-elapsed: 38.851875ms, GET "/api/v1/nodes/pause-20210915191040-306161" result: <nil>

	* ==> kube-controller-manager [a5f849b43b1c] <==

	* I0915 19:11:37.411967       1 shared_informer.go:247] Caches are synced for deployment

	I0915 19:11:37.414182       1 shared_informer.go:247] Caches are synced for PVC protection

	I0915 19:11:37.420105       1 shared_informer.go:247] Caches are synced for job

	I0915 19:11:37.425007       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring

	I0915 19:11:37.438253       1 shared_informer.go:247] Caches are synced for cronjob

	I0915 19:11:37.438264       1 shared_informer.go:247] Caches are synced for HPA

	I0915 19:11:37.438289       1 shared_informer.go:247] Caches are synced for certificate-csrapproving

	I0915 19:11:37.438302       1 shared_informer.go:247] Caches are synced for attach detach

	I0915 19:11:37.438587       1 shared_informer.go:247] Caches are synced for service account

	I0915 19:11:37.438657       1 shared_informer.go:247] Caches are synced for expand

	I0915 19:11:37.462666       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator

	I0915 19:11:37.523114       1 shared_informer.go:247] Caches are synced for resource quota

	I0915 19:11:37.530198       1 shared_informer.go:247] Caches are synced for daemon sets

	I0915 19:11:37.538172       1 shared_informer.go:247] Caches are synced for resource quota

	I0915 19:11:37.544233       1 shared_informer.go:247] Caches are synced for stateful set

	I0915 19:11:37.601354       1 shared_informer.go:247] Caches are synced for persistent volume

	I0915 19:11:38.046450       1 shared_informer.go:247] Caches are synced for garbage collector

	I0915 19:11:38.110631       1 shared_informer.go:247] Caches are synced for garbage collector

	I0915 19:11:38.110664       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0915 19:11:38.127841       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I0915 19:11:38.332278       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-m4kfv"

	I0915 19:11:38.429572       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-wgdfl"

	I0915 19:11:38.437471       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-fvrsb"

	I0915 19:11:38.578331       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I0915 19:11:38.582612       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-fvrsb"

	* ==> kube-proxy [d15f2b587bbf] <==

	* I0915 19:11:39.363141       1 node.go:172] Successfully retrieved node IP: 192.168.58.2

	I0915 19:11:39.363213       1 server_others.go:140] Detected node IP 192.168.58.2

	W0915 19:11:39.363234       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I0915 19:11:39.600471       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0915 19:11:39.600519       1 server_others.go:212] Using iptables Proxier.

	I0915 19:11:39.600534       1 server_others.go:219] creating dualStackProxier for iptables.

	W0915 19:11:39.600550       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0915 19:11:39.600893       1 server.go:649] Version: v1.22.1

	I0915 19:11:39.601741       1 config.go:315] Starting service config controller

	I0915 19:11:39.601782       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0915 19:11:39.601802       1 config.go:224] Starting endpoint slice config controller

	I0915 19:11:39.601807       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	E0915 19:11:39.608834       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191040-306161.16a5149bd9fff3a7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048af3ae3db7be0, ext:474764259, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191040-306161", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause

-20210915191040-306161", UID:"pause-20210915191040-306161", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191040-306161.16a5149bd9fff3a7" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)

	I0915 19:11:39.703082       1 shared_informer.go:247] Caches are synced for endpoint slice config

	I0915 19:11:39.703101       1 shared_informer.go:247] Caches are synced for service config

	* ==> kube-scheduler [b2b6bdeb15b9] <==

	* E0915 19:11:22.694638       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:11:22.702299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0915 19:11:22.702435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:11:22.702528       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.702603       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0915 19:11:22.702702       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:11:22.702774       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0915 19:11:22.702846       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.702958       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:11:22.703036       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:11:22.703110       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.703205       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:11:22.703278       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.703421       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:11:22.703439       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:11:23.563383       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:11:23.568607       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:11:23.616199       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:23.625013       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:23.682990       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:11:23.688603       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:11:23.721201       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:11:23.744652       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:11:23.777627       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	I0915 19:11:26.574973       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Wed 2021-09-15 19:10:43 UTC, end at Wed 2021-09-15 19:12:14 UTC. --

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895407    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/87e207cf7ed458dc963e57311bee91a6-etcd-certs\") pod \"etcd-pause-20210915191040-306161\" (UID: \"87e207cf7ed458dc963e57311bee91a6\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895438    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-usr-share-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895463    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/7de1da23176b119dfecc95ecb61dd307-etc-ca-certificates\") pod \"kube-controller-manager-pause-20210915191040-306161\" (UID: \"7de1da23176b119dfecc95ecb61dd307\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895490    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/7de1da23176b119dfecc95ecb61dd307-kubeconfig\") pod \"kube-controller-manager-pause-20210915191040-306161\" (UID: \"7de1da23176b119dfecc95ecb61dd307\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895515    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/87e207cf7ed458dc963e57311bee91a6-etcd-data\") pod \"etcd-pause-20210915191040-306161\" (UID: \"87e207cf7ed458dc963e57311bee91a6\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895541    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-etc-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895566    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-k8s-certs\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895594    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-usr-local-share-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.468719    4310 apiserver.go:52] "Watching apiserver"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.472864    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.473029    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.473090    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499643    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xmq\" (UniqueName: \"kubernetes.io/projected/6ec6737e-98cf-42bd-a911-9c89db377921-kube-api-access-r9xmq\") pod \"storage-provisioner\" (UID: \"6ec6737e-98cf-42bd-a911-9c89db377921\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499775    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/136bb615-a920-412f-b4ce-fdeeb75acfcb-xtables-lock\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499812    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/6ec6737e-98cf-42bd-a911-9c89db377921-tmp\") pod \"storage-provisioner\" (UID: \"6ec6737e-98cf-42bd-a911-9c89db377921\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499841    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/136bb615-a920-412f-b4ce-fdeeb75acfcb-kube-proxy\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499868    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh642\" (UniqueName: \"kubernetes.io/projected/136bb615-a920-412f-b4ce-fdeeb75acfcb-kube-api-access-sh642\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499900    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf5qs\" (UniqueName: \"kubernetes.io/projected/1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83-kube-api-access-tf5qs\") pod \"coredns-78fcd69978-wgdfl\" (UID: \"1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499929    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/136bb615-a920-412f-b4ce-fdeeb75acfcb-lib-modules\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499956    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83-config-volume\") pod \"coredns-78fcd69978-wgdfl\" (UID: \"1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499971    4310 reconciler.go:157] "Reconciler: start to sync state"

	Sep 15 19:11:57 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:57.602522    4310 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: kubelet.service: Succeeded.

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [bba215ebb412] <==

	* I0915 19:11:51.762405       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0915 19:11:51.771218       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0915 19:11:51.771251       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0915 19:11:51.787868       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0915 19:11:51.788000       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b!

	I0915 19:11:51.788045       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"4cc154c3-2477-4781-8800-3bd0adce3c8a", APIVersion:"v1", ResourceVersion:"488", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b became leader

	I0915 19:11:51.888127       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b!

-- /stdout --

** stderr **

	E0915 19:12:14.073177  484675 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:250: failed logs error: exit status 110

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect pause-20210915191040-306161

helpers_test.go:236: (dbg) docker inspect pause-20210915191040-306161:

-- stdout --

	        "Id": "bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061",

	        "Created": "2021-09-15T19:10:42.551354157Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 459889,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-09-15T19:10:43.169524869Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

},

	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",

	        "ResolvConfPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/hostname",

	        "HostsPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/hosts",

	        "LogPath": "/var/lib/docker/containers/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061/bca902ad6107c32b526bd51ea94e9df6f7607330dfc07e7e90b9556bf40fb061-json.log",

	        "Name": "/pause-20210915191040-306161",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "pause-20210915191040-306161:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "pause-20210915191040-306161",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e-init/diff:/var/lib/docker/overlay2/42af7561be1bbb04e60d5898b29ceee8cccacce1c1e5ac5a5471bd2c2eb199c1/diff:/var/lib/docker/overlay2/751fc28b4872d1d49285c85a1cc36b03020834feb891b324f4934fc7bbb2a6ad/diff:/var/lib/docker/overlay2/0ecc58bf735cb0b519ef22a62daf0e530d708564e0b5e2a32c0d2dfbf82c31f1/diff:/var/lib/docker/overlay2/40f6c03795cd703755126d403a243ddfa2b5a61c04ba64a54188be2d675512f0/diff:/var/lib/docker/overlay2/c1ed82aa36dccda427851e6e631dda57f4ea197ec647ed726ad163b6ab37743f/diff:/var/lib/docker/overlay2/80d741d1e18c6360d99304165056959acb58e58f7c7d3b65d8d53565555b4030/diff:/var/lib/docker/overlay2/447eff9d25dbd151310c8d31d34423f404bc92869252861a8515d52575670208/diff:/var/lib/docker/overlay2/c0772139dfb4023aacb541a406a5e5d1697bd07fb74faf19f0f70c0378a6a0aa/diff:/var/lib/docker/overlay2/b6bb35ea8704143c911f2f148b8a83fb1595e56bdb785ad83f7f5b0ba255050b/diff:/var/lib/docker/overlay2/77cfc0

f9841fd241edda977799472f43ff62c670f7f0dc94936630ed52e1b91e/diff:/var/lib/docker/overlay2/47450527f7ce6a152d348dbe5dac4026cc11f3f715cf7e7b7ea7e797df3f5cf4/diff:/var/lib/docker/overlay2/5ea3e2569f810895df6596566930f3068e5c5d42831d6bda8de83d19c1185d3f/diff:/var/lib/docker/overlay2/d116c54fdfbaac2c30c98b1317c22640c46f07f3f9924da3e450e7cc3f026f3b/diff:/var/lib/docker/overlay2/4f1d2222e5e679ccc39dcf8be0e0caad5028cf91c0cc32b4025b79da0530cf79/diff:/var/lib/docker/overlay2/d395fbc24d899f00e3584b6298d4b2d46f9c834636fa54bf82aec3d8bf7aa1e4/diff:/var/lib/docker/overlay2/a294a18c3929a26e58691a4f489d1d4ed51d12a1c252dc68fdee0b9bddededd1/diff:/var/lib/docker/overlay2/8bba47552514f0de9059dcaf0fac98e702505d70e78a52d0394a82f5fc85fa37/diff:/var/lib/docker/overlay2/020c4987317db46a4f9cdc01cf984f014ead8756b3e1c340fb8f181a80339c1c/diff:/var/lib/docker/overlay2/a9def08cecacaa841f943f37f2b4027d2b8c9c6b2a0e55d4844d2c257eddd0e6/diff:/var/lib/docker/overlay2/17ef9dd7c4c56b129b7bcdf2629184e963776cba2a5484bd18ca3102b68d02cc/diff:/var/lib/d

ocker/overlay2/8d91d9e3464303a35c2d8a3a3f93f0ab30cd9fe6fa28c942ddc92769cf590ac9/diff:/var/lib/docker/overlay2/9830b73f3f06b9fc4f470e3b1dc16b8a3299272056c5131a298e6bb42a083941/diff:/var/lib/docker/overlay2/ea9d596d994ea5dfd5a26427720cb2e8361d797aa279267428df94c19a9d7c44/diff:/var/lib/docker/overlay2/2e1466e09da2855871ebe76fbcffcb15fd134652525feb0105fe152a084d210e/diff:/var/lib/docker/overlay2/9bdc54e7df3f3e5c2597a98b2737c550e37e1f78d16859fb6518d8b440ca0b08/diff:/var/lib/docker/overlay2/5037f238f4a3fe4dab6cd163114a4e1ff421eac25c08e1692759c11df7b3ee16/diff:/var/lib/docker/overlay2/873666dc974cc73345c5bdf7408c32b17137d25cc199834ebd8660d05c9481e2/diff:/var/lib/docker/overlay2/139b02d97d4069f11d6bc3503baa4785c0a78b8bd7bc9cb27acaf894f3107aa9/diff:/var/lib/docker/overlay2/6e6fd6abdb501264791d7c049ecc9089ab221a7aa6f4cbb745874fefd93cf871/diff:/var/lib/docker/overlay2/11575ed178ccca3cb09dfeb7628b08e11e6a3357f3659c2890a288ce9f2ba782/diff:/var/lib/docker/overlay2/bb3435980235e05ccce2d74ef847a0acd46c4edf0d38983388b271aa9dd

b6053/diff:/var/lib/docker/overlay2/0e3e4464369c9a27193d7ad87e67c5485363aeabca8fcbc6855eab5789e4c2a5/diff:/var/lib/docker/overlay2/41e71fdf4be3041a17553878254d63ea1c8c4063994bf2725203012ee9dd93c5/diff:/var/lib/docker/overlay2/76ee62595a4ab520c3233836c68c0bc0297b3907fff6db1b659f16f4325b8d3c/diff:/var/lib/docker/overlay2/dc211f5ed531b1debbcdd38dd7129b846d5e959af10f3144da2541b5c6f0233b/diff:/var/lib/docker/overlay2/6822a79442f86fb63c1067f542f9f6ce9288d3cec3ed6330fce4a6e3f48db77e/diff:/var/lib/docker/overlay2/757fc4ce96317e0c241e2344c927a20f4844398da422284baf7de7aebb6f828f/diff:/var/lib/docker/overlay2/3672ef17e397e206ae409a53d2bca46c162142ff01c54c787ba59f0bf2dad58a/diff:/var/lib/docker/overlay2/e04f51cc901a2cc97f893a3d4c6ebb453df442a6d57974d1b702d6ad1efab159/diff",

	                "MergedDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/5e3ffb7c28acf9d38fbd1aa28f21ed029817d0ac81f88df792ac7af13d5d5d8e/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "volume",

	                "Name": "pause-20210915191040-306161",

	                "Source": "/var/lib/docker/volumes/pause-20210915191040-306161/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

},

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

],

	        "Config": {

	            "Hostname": "pause-20210915191040-306161",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "pause-20210915191040-306161",

	                "name.minikube.sigs.k8s.io": "pause-20210915191040-306161",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "df07212579862d4f5ae99ffb739ae3c99da6a0412ff03dd0d6816a60189e779d",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33118"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33117"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33112"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33116"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33114"

},

	            "SandboxKey": "/var/run/docker/netns/df0721257986",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "pause-20210915191040-306161": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "bca902ad6107"

],

	                    "NetworkID": "515ea92b2bf138022bfb99d0055b7e5e76b1d54cb7cfb53912aad56a462f4219",

	                    "EndpointID": "a897f77a4ed3bef902f3cd13240fca7c0c0e799541ca81af9ad32dd3573eec4d",

	                    "Gateway": "192.168.58.1",

	                    "IPAddress": "192.168.58.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:3a:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191040-306161 -n pause-20210915191040-306161

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p pause-20210915191040-306161 -n pause-20210915191040-306161: exit status 2 (443.569974ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:240: status error: exit status 2 (may be ok)

helpers_test.go:245: <<< TestPause/serial/PauseAgain FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestPause/serial/PauseAgain]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p pause-20210915191040-306161 logs -n 25

=== CONT  TestPause/serial/PauseAgain

helpers_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 -p pause-20210915191040-306161 logs -n 25: exit status 110 (13.211185347s)

-- stdout --

	* ==> Audit <==

	* |------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	|  Command   |                    Args                    |                  Profile                   |   User   | Version |          Start Time           |           End Time            |

	|------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	| ssh        | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:07:32 UTC | Wed, 15 Sep 2021 19:07:35 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | -- docker pull busybox                     |                                            |          |         |                               |                               |

	| start      | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:07:35 UTC | Wed, 15 Sep 2021 19:08:08 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr            |                                            |          |         |                               |                               |

	|            | -v=1 --wait=true --driver=docker           |                                            |          |         |                               |                               |

	|            |  --container-runtime=docker                |                                            |          |         |                               |                               |

	|            | --kubernetes-version=v1.17.3               |                                            |          |         |                               |                               |

	| ssh        | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:08 UTC | Wed, 15 Sep 2021 19:08:09 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	|            | -- docker images                           |                                            |          |         |                               |                               |

	| delete     | -p                                         | test-preload-20210915190619-306161         | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:09 UTC | Wed, 15 Sep 2021 19:08:14 UTC |

	|            | test-preload-20210915190619-306161         |                                            |          |         |                               |                               |

	| start      | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:14 UTC | Wed, 15 Sep 2021 19:08:36 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --memory=2048 --driver=docker              |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| stop       | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:36 UTC | Wed, 15 Sep 2021 19:08:36 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --cancel-scheduled                         |                                            |          |         |                               |                               |

	| stop       | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:08:54 UTC | Wed, 15 Sep 2021 19:09:10 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	|            | --schedule 5s                              |                                            |          |         |                               |                               |

	| delete     | -p                                         | scheduled-stop-20210915190814-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:09:19 UTC | Wed, 15 Sep 2021 19:09:21 UTC |

	|            | scheduled-stop-20210915190814-306161       |                                            |          |         |                               |                               |

	| start      | -p                                         | skaffold-20210915190921-306161             | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:09:22 UTC | Wed, 15 Sep 2021 19:09:43 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	|            | --memory=2600 --driver=docker              |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| docker-env | --shell none -p                            | skaffold-20210915190921-306161             | skaffold | v1.23.0 | Wed, 15 Sep 2021 19:09:44 UTC | Wed, 15 Sep 2021 19:09:44 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	|            | --user=skaffold                            |                                            |          |         |                               |                               |

	| delete     | -p                                         | skaffold-20210915190921-306161             | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:27 UTC | Wed, 15 Sep 2021 19:10:30 UTC |

	|            | skaffold-20210915190921-306161             |                                            |          |         |                               |                               |

	| delete     | -p                                         | insufficient-storage-20210915191030-306161 | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:38 UTC | Wed, 15 Sep 2021 19:10:40 UTC |

	|            | insufficient-storage-20210915191030-306161 |                                            |          |         |                               |                               |

	| delete     | -p                                         | flannel-20210915191040-306161              | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:10:40 UTC |

	|            | flannel-20210915191040-306161              |                                            |          |         |                               |                               |

	| start      | -p                                         | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:27 UTC |

	|            | force-systemd-flag-20210915191040-306161   |                                            |          |         |                               |                               |

	|            | --memory=2048 --force-systemd              |                                            |          |         |                               |                               |

	|            | --alsologtostderr -v=5 --driver=docker     |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| -p         | force-systemd-flag-20210915191040-306161   | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:27 UTC | Wed, 15 Sep 2021 19:11:28 UTC |

	|            | ssh docker info --format                   |                                            |          |         |                               |                               |

	|            | {{.CgroupDriver}}                          |                                            |          |         |                               |                               |

	| delete     | -p                                         | force-systemd-flag-20210915191040-306161   | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:28 UTC | Wed, 15 Sep 2021 19:11:30 UTC |

	|            | force-systemd-flag-20210915191040-306161   |                                            |          |         |                               |                               |

	| start      | -p                                         | offline-docker-20210915191040-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:42 UTC |

	|            | offline-docker-20210915191040-306161       |                                            |          |         |                               |                               |

	|            | --alsologtostderr -v=1 --memory=2048       |                                            |          |         |                               |                               |

	|            | --wait=true --driver=docker                |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| start      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:10:40 UTC | Wed, 15 Sep 2021 19:11:42 UTC |

	|            | --memory=2048                              |                                            |          |         |                               |                               |

	|            | --install-addons=false                     |                                            |          |         |                               |                               |

	|            | --wait=all --driver=docker                 |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| delete     | -p                                         | offline-docker-20210915191040-306161       | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:42 UTC | Wed, 15 Sep 2021 19:11:50 UTC |

	|            | offline-docker-20210915191040-306161       |                                            |          |         |                               |                               |

	| start      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:43 UTC | Wed, 15 Sep 2021 19:11:52 UTC |

	|            | --alsologtostderr                          |                                            |          |         |                               |                               |

	|            | -v=1 --driver=docker                       |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| pause      | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:52 UTC | Wed, 15 Sep 2021 19:11:52 UTC |

	|            | --alsologtostderr -v=5                     |                                            |          |         |                               |                               |

	| unpause    | -p pause-20210915191040-306161             | pause-20210915191040-306161                | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:53 UTC | Wed, 15 Sep 2021 19:11:55 UTC |

	|            | --alsologtostderr -v=5                     |                                            |          |         |                               |                               |

	| start      | -p                                         | force-systemd-env-20210915191133-306161    | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:11:33 UTC | Wed, 15 Sep 2021 19:12:04 UTC |

	|            | force-systemd-env-20210915191133-306161    |                                            |          |         |                               |                               |

	|            | --memory=2048 --alsologtostderr            |                                            |          |         |                               |                               |

	|            | -v=5 --driver=docker                       |                                            |          |         |                               |                               |

	|            | --container-runtime=docker                 |                                            |          |         |                               |                               |

	| -p         | force-systemd-env-20210915191133-306161    | force-systemd-env-20210915191133-306161    | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:12:04 UTC | Wed, 15 Sep 2021 19:12:05 UTC |

	|            | ssh docker info --format                   |                                            |          |         |                               |                               |

	|            | {{.CgroupDriver}}                          |                                            |          |         |                               |                               |

	| delete     | -p                                         | force-systemd-env-20210915191133-306161    | jenkins  | v1.23.0 | Wed, 15 Sep 2021 19:12:05 UTC | Wed, 15 Sep 2021 19:12:07 UTC |

	|            | force-systemd-env-20210915191133-306161    |                                            |          |         |                               |                               |

	|------------|--------------------------------------------|--------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 19:12:08

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 19:12:08.025776  487286 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:12:08.025870  487286 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:12:08.025874  487286 out.go:311] Setting ErrFile to fd 2...

	I0915 19:12:08.025880  487286 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:12:08.026026  487286 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:12:08.026358  487286 out.go:305] Setting JSON to false

	I0915 19:12:08.070601  487286 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":17505,"bootTime":1631715623,"procs":254,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 19:12:08.070728  487286 start.go:121] virtualization: kvm guest

	I0915 19:12:08.073355  487286 out.go:177] * [kubernetes-upgrade-20210915191207-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	I0915 19:12:08.075064  487286 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:12:08.073502  487286 notify.go:169] Checking for updates...

	I0915 19:12:08.076702  487286 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 19:12:08.078352  487286 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 19:12:08.079865  487286 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 19:12:08.080406  487286 config.go:177] Loaded profile config "missing-upgrade-20210915191150-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0915 19:12:08.080528  487286 config.go:177] Loaded profile config "pause-20210915191040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 19:12:08.080620  487286 config.go:177] Loaded profile config "stopped-upgrade-20210915191040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0915 19:12:08.080670  487286 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 19:12:08.137947  487286 docker.go:132] docker version: linux-19.03.15

	I0915 19:12:08.138091  487286 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:12:08.237284  487286 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:61 OomKillDisable:true NGoroutines:67 SystemTime:2021-09-15 19:12:08.178091982 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:12:08.237381  487286 docker.go:237] overlay module found

	I0915 19:12:08.239770  487286 out.go:177] * Using the docker driver based on user configuration

	I0915 19:12:08.239801  487286 start.go:278] selected driver: docker

	I0915 19:12:08.239807  487286 start.go:751] validating driver "docker" against <nil>

	I0915 19:12:08.239837  487286 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 19:12:08.239895  487286 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:12:08.239920  487286 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:12:08.241421  487286 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:12:08.242340  487286 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:12:08.339765  487286 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:true NGoroutines:71 SystemTime:2021-09-15 19:12:08.284891271 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:12:08.339975  487286 start_flags.go:264] no existing cluster config was found, will generate one from the flags

	I0915 19:12:08.340202  487286 start_flags.go:719] Wait components to verify : map[apiserver:true system_pods:true]

	I0915 19:12:08.340237  487286 cni.go:93] Creating CNI manager for ""

	I0915 19:12:08.340246  487286 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:12:08.340255  487286 start_flags.go:278] config:

	{Name:kubernetes-upgrade-20210915191207-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20210915191207-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c

luster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:12:08.342705  487286 out.go:177] * Starting control plane node kubernetes-upgrade-20210915191207-306161 in cluster kubernetes-upgrade-20210915191207-306161

	I0915 19:12:08.342754  487286 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 19:12:08.344353  487286 out.go:177] * Pulling base image ...

	I0915 19:12:08.344402  487286 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime docker

	I0915 19:12:08.344442  487286 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.14.0-docker-overlay2-amd64.tar.lz4

	I0915 19:12:08.344459  487286 cache.go:57] Caching tarball of preloaded images

	I0915 19:12:08.344487  487286 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	I0915 19:12:08.344607  487286 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.14.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0915 19:12:08.344631  487286 cache.go:60] Finished verifying existence of preloaded tar for  v1.14.0 on docker

	I0915 19:12:08.344766  487286 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191207-306161/config.json ...

	I0915 19:12:08.344799  487286 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubernetes-upgrade-20210915191207-306161/config.json: {Name:mkeb777a02fe11607f3344dcdec3a99f83a463ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:12:08.452652  487286 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 19:12:08.452705  487286 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 19:12:08.452725  487286 cache.go:206] Successfully downloaded all kic artifacts

	I0915 19:12:08.452801  487286 start.go:313] acquiring machines lock for kubernetes-upgrade-20210915191207-306161: {Name:mkdcde9b9510cd8c0953e2aab39569e6c028f446 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:12:08.452979  487286 start.go:317] acquired machines lock for "kubernetes-upgrade-20210915191207-306161" in 150.4µs

	I0915 19:12:08.453018  487286 start.go:89] Provisioning new machine with config: &{Name:kubernetes-upgrade-20210915191207-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20210915191207-306161 Namesp

ace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}

	I0915 19:12:08.453131  487286 start.go:126] createHost starting for "" (driver="docker")

	I0915 19:12:08.324812  482400 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5 from cache

	I0915 19:12:08.324859  482400 docker.go:206] Loading image: /var/lib/minikube/images/metrics-scraper_v1.0.4

	I0915 19:12:08.324878  482400 ssh_runner.go:152] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.4 | docker load"

	I0915 19:12:09.375311  482400 ssh_runner.go:192] Completed: /bin/bash -c "sudo cat /var/lib/minikube/images/metrics-scraper_v1.0.4 | docker load": (1.05041394s)

	I0915 19:12:09.375340  482400 cache_images.go:309] Transferred and loaded /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 from cache

	I0915 19:12:09.375381  482400 docker.go:206] Loading image: /var/lib/minikube/images/dashboard_v2.1.0

	I0915 19:12:09.375429  482400 ssh_runner.go:152] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/dashboard_v2.1.0 | docker load"

	I0915 19:12:08.456384  487286 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0915 19:12:08.456677  487286 start.go:160] libmachine.API.Create for "kubernetes-upgrade-20210915191207-306161" (driver="docker")

	I0915 19:12:08.456711  487286 client.go:168] LocalClient.Create starting

	I0915 19:12:08.456807  487286 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem

	I0915 19:12:08.456838  487286 main.go:130] libmachine: Decoding PEM data...

	I0915 19:12:08.456855  487286 main.go:130] libmachine: Parsing certificate...

	I0915 19:12:08.457027  487286 main.go:130] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem

	I0915 19:12:08.457059  487286 main.go:130] libmachine: Decoding PEM data...

	I0915 19:12:08.457073  487286 main.go:130] libmachine: Parsing certificate...

	I0915 19:12:08.457489  487286 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20210915191207-306161 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0915 19:12:08.502597  487286 cli_runner.go:162] docker network inspect kubernetes-upgrade-20210915191207-306161 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0915 19:12:08.502692  487286 network_create.go:255] running [docker network inspect kubernetes-upgrade-20210915191207-306161] to gather additional debugging logs...

	I0915 19:12:08.502713  487286 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20210915191207-306161

	W0915 19:12:08.551490  487286 cli_runner.go:162] docker network inspect kubernetes-upgrade-20210915191207-306161 returned with exit code 1

	I0915 19:12:08.551535  487286 network_create.go:258] error running [docker network inspect kubernetes-upgrade-20210915191207-306161]: docker network inspect kubernetes-upgrade-20210915191207-306161: exit status 1

	stdout:

[]

	stderr:

	Error: No such network: kubernetes-upgrade-20210915191207-306161

	I0915 19:12:08.551553  487286 network_create.go:260] output of [docker network inspect kubernetes-upgrade-20210915191207-306161]: -- stdout --

[]

	-- /stdout --

	** stderr **

	Error: No such network: kubernetes-upgrade-20210915191207-306161

	** /stderr **

	I0915 19:12:08.551613  487286 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0915 19:12:08.597483  487286 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0006f8010] misses:0}

	I0915 19:12:08.597544  487286 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0915 19:12:08.597565  487286 network_create.go:106] attempt to create docker network kubernetes-upgrade-20210915191207-306161 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0915 19:12:08.597626  487286 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20210915191207-306161

	I0915 19:12:08.692042  487286 network_create.go:90] docker network kubernetes-upgrade-20210915191207-306161 192.168.49.0/24 created

	I0915 19:12:08.692085  487286 kic.go:106] calculated static IP "192.168.49.2" for the "kubernetes-upgrade-20210915191207-306161" container

	I0915 19:12:08.692152  487286 cli_runner.go:115] Run: docker ps -a --format {{.Names}}

	I0915 19:12:08.743176  487286 cli_runner.go:115] Run: docker volume create kubernetes-upgrade-20210915191207-306161 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20210915191207-306161 --label created_by.minikube.sigs.k8s.io=true

	I0915 19:12:08.795661  487286 oci.go:102] Successfully created a docker volume kubernetes-upgrade-20210915191207-306161

	I0915 19:12:08.795773  487286 cli_runner.go:115] Run: docker run --rm --name kubernetes-upgrade-20210915191207-306161-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20210915191207-306161 --entrypoint /usr/bin/test -v kubernetes-upgrade-20210915191207-306161:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -d /var/lib

	I0915 19:12:09.634169  487286 oci.go:106] Successfully prepared a docker volume kubernetes-upgrade-20210915191207-306161

	W0915 19:12:09.634234  487286 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	W0915 19:12:09.634245  487286 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	I0915 19:12:09.634306  487286 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime docker

	I0915 19:12:09.634349  487286 kic.go:179] Starting extracting preloaded images to volume ...

	I0915 19:12:09.634362  487286 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0915 19:12:09.634418  487286 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.14.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-20210915191207-306161:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir

	I0915 19:12:09.728226  487286 cli_runner.go:115] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20210915191207-306161 --name kubernetes-upgrade-20210915191207-306161 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20210915191207-306161 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20210915191207-306161 --network kubernetes-upgrade-20210915191207-306161 --ip 192.168.49.2 --volume kubernetes-upgrade-20210915191207-306161:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56

	I0915 19:12:10.305853  487286 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191207-306161 --format={{.State.Running}}

	I0915 19:12:10.361801  487286 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191207-306161 --format={{.State.Status}}

	I0915 19:12:10.412716  487286 cli_runner.go:115] Run: docker exec kubernetes-upgrade-20210915191207-306161 stat /var/lib/dpkg/alternatives/iptables

	I0915 19:12:10.561256  487286 oci.go:281] the created container "kubernetes-upgrade-20210915191207-306161" has a running status.

	I0915 19:12:10.561290  487286 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/kubernetes-upgrade-20210915191207-306161/id_rsa...

	I0915 19:12:10.901623  487286 kic_runner.go:188] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/kubernetes-upgrade-20210915191207-306161/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0915 19:12:11.296134  487286 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20210915191207-306161 --format={{.State.Status}}

	I0915 19:12:11.347200  487286 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0915 19:12:11.347224  487286 kic_runner.go:115] Args: [docker exec --privileged kubernetes-upgrade-20210915191207-306161 chown docker:docker /home/docker/.ssh/authorized_keys]

	* ==> Docker <==

	* -- Logs begin at Wed 2021-09-15 19:10:43 UTC, end at Wed 2021-09-15 19:12:15 UTC. --

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.748712844Z" level=info msg="Starting up"

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750726725Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750759815Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750780766Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.750789481Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752119284Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752145616Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752162703Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.752175184Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Sep 15 19:10:54 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:10:54.785563417Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.554871470Z" level=warning msg="Your kernel does not support swap memory limit"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.554906136Z" level=warning msg="Your kernel does not support CPU realtime scheduler"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.555074626Z" level=info msg="Loading containers: start."

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.683507911Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.723475583Z" level=info msg="Loading containers: done."

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.769826862Z" level=info msg="Docker daemon" commit=75249d8 graphdriver(s)=overlay2 version=20.10.8

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.769898162Z" level=info msg="Daemon has completed initialization"

	Sep 15 19:11:09 pause-20210915191040-306161 systemd[1]: Started Docker Application Container Engine.

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.795475313Z" level=info msg="API listen on [::]:2376"

	Sep 15 19:11:09 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:09.801062171Z" level=info msg="API listen on /var/run/docker.sock"

	Sep 15 19:11:39 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:39.846858888Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:11:39 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:39.912853399Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:11:46 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:46.010009521Z" level=info msg="ignoring event" container=911ed5b73e6164b00cf21e7a002849689816a87dee31cfd456db3785edf19049 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:11:49 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:49.461607020Z" level=info msg="ignoring event" container=6b92c509ec02896125a066229c0d5f6d8bfe46bc786dae6c3721a2946143e297 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:11:57 pause-20210915191040-306161 dockerd[450]: time="2021-09-15T19:11:57.959519722Z" level=error msg="Handler for POST /v1.41/containers/05fa6730f481/pause returned error: Cannot pause container 05fa6730f48169d2ac729d988cd9323576ee6eec8a609c586992b637f8c4d022: OCI runtime pause failed: unable to freeze: unknown"

	* ==> container status <==

	* time="2021-09-15T19:12:17Z" level=fatal msg="connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded"

	CONTAINER ID   IMAGE                  COMMAND                  CREATED              STATUS                      PORTS     NAMES

	bba215ebb412   6e38f40d628d           "/storage-provisioner"   26 seconds ago       Up 25 seconds (Paused)                k8s_storage-provisioner_storage-provisioner_kube-system_6ec6737e-98cf-42bd-a911-9c89db377921_0

	34c35294796d   k8s.gcr.io/pause:3.5   "/pause"                 26 seconds ago       Up 26 seconds (Paused)                k8s_POD_storage-provisioner_kube-system_6ec6737e-98cf-42bd-a911-9c89db377921_0

	3dcc70b67afa   8d147537fb7d           "/coredns -conf /etc…"   38 seconds ago       Up 37 seconds (Paused)                k8s_coredns_coredns-78fcd69978-wgdfl_kube-system_1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83_0

	d15f2b587bbf   36c4ebbc9d97           "/usr/local/bin/kube…"   39 seconds ago       Up 38 seconds (Paused)                k8s_kube-proxy_kube-proxy-m4kfv_kube-system_136bb615-a920-412f-b4ce-fdeeb75acfcb_0

	6b92c509ec02   k8s.gcr.io/pause:3.5   "/pause"                 39 seconds ago       Exited (0) 28 seconds ago             k8s_POD_coredns-78fcd69978-fvrsb_kube-system_595bf515-bff7-4331-9552-89a5ba57ca6b_0

	8dd7be01f740   k8s.gcr.io/pause:3.5   "/pause"                 39 seconds ago       Up 37 seconds (Paused)                k8s_POD_coredns-78fcd69978-wgdfl_kube-system_1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83_0

	74da63129b6f   k8s.gcr.io/pause:3.5   "/pause"                 39 seconds ago       Up 38 seconds (Paused)                k8s_POD_kube-proxy-m4kfv_kube-system_136bb615-a920-412f-b4ce-fdeeb75acfcb_0

	a5f849b43b1c   6e002eb89a88           "kube-controller-man…"   About a minute ago   Up 59 seconds (Paused)                k8s_kube-controller-manager_kube-controller-manager-pause-20210915191040-306161_kube-system_7de1da23176b119dfecc95ecb61dd307_0

	b2b6bdeb15b9   aca5ededae9c           "kube-scheduler --au…"   About a minute ago   Up 59 seconds (Paused)                k8s_kube-scheduler_kube-scheduler-pause-20210915191040-306161_kube-system_1a018d46efe067cf543c61ee8873be83_0

	27693cb21ee8   f30469a2491a           "kube-apiserver --ad…"   About a minute ago   Up 59 seconds (Paused)                k8s_kube-apiserver_kube-apiserver-pause-20210915191040-306161_kube-system_b43c2d1987c2753ab3b743454432ec65_0

	05fa6730f481   004811815584           "etcd --advertise-cl…"   About a minute ago   Up 59 seconds                         k8s_etcd_etcd-pause-20210915191040-306161_kube-system_87e207cf7ed458dc963e57311bee91a6_0

	cd525100a832   k8s.gcr.io/pause:3.5   "/pause"                 About a minute ago   Up 59 seconds (Paused)                k8s_POD_kube-scheduler-pause-20210915191040-306161_kube-system_1a018d46efe067cf543c61ee8873be83_0

	5da3019bf389   k8s.gcr.io/pause:3.5   "/pause"                 About a minute ago   Up 59 seconds (Paused)                k8s_POD_kube-controller-manager-pause-20210915191040-306161_kube-system_7de1da23176b119dfecc95ecb61dd307_0

	2b95e975790b   k8s.gcr.io/pause:3.5   "/pause"                 About a minute ago   Up 59 seconds (Paused)                k8s_POD_kube-apiserver-pause-20210915191040-306161_kube-system_b43c2d1987c2753ab3b743454432ec65_0

	ce786a1a3e58   k8s.gcr.io/pause:3.5   "/pause"                 About a minute ago   Up 59 seconds (Paused)                k8s_POD_etcd-pause-20210915191040-306161_kube-system_87e207cf7ed458dc963e57311bee91a6_0

	* ==> coredns [3dcc70b67afa] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* ==> dmesg <==

	* [ +17.772866] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 18:54] cgroup: cgroup2: unknown option "nsdelegate"

	[  +6.702807] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev veth8705e930

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 12 69 6e a5 f0 15 08 06        .......in.....

	[Sep15 18:55] cgroup: cgroup2: unknown option "nsdelegate"

	[ +16.873151] IPv4: martian source 10.244.0.2 from 10.244.0.2, on dev vethfb23be6d

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff aa c8 da 40 c8 b6 08 06        .........@....

	[  +1.199924] IPv4: martian source 10.244.0.3 from 10.244.0.3, on dev veth7db36ce7

	[  +0.000003] ll header: 00000000: ff ff ff ff ff ff ce 61 5a cc 64 d4 08 06        .......aZ.d...

	[ +13.998812] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 18:56] IPv4: martian source 10.244.1.2 from 10.244.1.2, on dev vethd9ced9de

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 76 3d db ca 7d c7 08 06        ......v=..}...

	[  +4.397740] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:06] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:08] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:09] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:10] cgroup: cgroup2: unknown option "nsdelegate"

	[ +10.362374] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.511989] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.528368] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:11] cgroup: cgroup2: unknown option "nsdelegate"

	[ +26.565621] cgroup: cgroup2: unknown option "nsdelegate"

	[ +24.216665] cgroup: cgroup2: unknown option "nsdelegate"

	[  +0.000652] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:12] cgroup: cgroup2: unknown option "nsdelegate"

	* ==> etcd [05fa6730f481] <==

	* {"level":"warn","ts":"2021-09-15T19:11:57.608Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"205.990111ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/etcd-pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[334900010] range","detail":"{range_begin:/registry/pods/kube-system/etcd-pause-20210915191040-306161; range_end:; }","duration":"206.246114ms","start":"2021-09-15T19:11:57.402Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[334900010] 'agreement among raft nodes before linearized reading'  (duration: 205.986899ms)"],"step_count":1}

	{"level":"warn","ts":"2021-09-15T19:11:57.608Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"209.587999ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[1188001142] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-pause-20210915191040-306161; range_end:; }","duration":"209.88735ms","start":"2021-09-15T19:11:57.399Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[1188001142] 'agreement among raft nodes before linearized reading'  (duration: 209.585643ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.609Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"205.22734ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/pause-20210915191040-306161\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[1804048700] range","detail":"{range_begin:/registry/minions/pause-20210915191040-306161; range_end:; }","duration":"205.267382ms","start":"2021-09-15T19:11:57.404Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[1804048700] 'agreement among raft nodes before linearized reading'  (duration: 205.22617ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.609Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"211.41271ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-proxy-m4kfv\" ","response":"","error":"context canceled"}

	{"level":"info","ts":"2021-09-15T19:11:57.609Z","caller":"traceutil/trace.go:171","msg":"trace[72393194] range","detail":"{range_begin:/registry/pods/kube-system/kube-proxy-m4kfv; range_end:; }","duration":"211.45198ms","start":"2021-09-15T19:11:57.398Z","end":"2021-09-15T19:11:57.609Z","steps":["trace[72393194] 'agreement among raft nodes before linearized reading'  (duration: 211.424329ms)"],"step_count":1}

	WARNING: 2021/09/15 19:11:57 [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2021-09-15T19:11:57.899Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:58.400Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:58.900Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:59.401Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:11:59.902Z","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":3238505855747361020,"retry-timeout":"500ms"}

	{"level":"warn","ts":"2021-09-15T19:12:00.385Z","caller":"wal/wal.go:802","msg":"slow fdatasync","took":"2.975183355s","expected-duration":"1s"}

	{"level":"info","ts":"2021-09-15T19:12:00.386Z","caller":"traceutil/trace.go:171","msg":"trace[649689859] transaction","detail":"{read_only:false; response_revision:499; number_of_response:1; }","duration":"2.985361187s","start":"2021-09-15T19:11:57.401Z","end":"2021-09-15T19:12:00.386Z","steps":["trace[649689859] 'process raft request'  (duration: 2.985215108s)"],"step_count":1}

	{"level":"warn","ts":"2021-09-15T19:12:00.386Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2021-09-15T19:11:57.401Z","time spent":"2.985466989s","remote":"127.0.0.1:49570","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1114,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:491 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:1041 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >"}

	{"level":"info","ts":"2021-09-15T19:12:00.387Z","caller":"traceutil/trace.go:171","msg":"trace[1681736244] linearizableReadLoop","detail":"{readStateIndex:521; appliedIndex:515; }","duration":"2.988488142s","start":"2021-09-15T19:11:57.398Z","end":"2021-09-15T19:12:00.386Z","steps":["trace[1681736244] 'read index received'  (duration: 2.986831523s)","trace[1681736244] 'applied index is now lower than readState.Index'  (duration: 1.655849ms)"],"step_count":2}

	* ==> kernel <==

	*  19:12:27 up  4:52,  0 users,  load average: 6.32, 3.31, 1.83

	Linux pause-20210915191040-306161 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [27693cb21ee8] <==

	* I0915 19:11:57.612216       1 trace.go:205] Trace[90908807]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:4e96f995-20f4-46d9-9e91-48a3165f9dbc,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:54.869) (total time: 2742ms):

	Trace[90908807]: [2.742216687s] [2.742216687s] END

	E0915 19:11:57.612302       1 timeout.go:135] post-timeout activity - time-elapsed: 3.47907ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E0915 19:11:57.613288       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.618821       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.620020       1 writers.go:117] apiserver was unable to write a JSON response: http: Handler timeout

	E0915 19:11:57.621075       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.624382       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.634372       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.635509       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.636607       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0915 19:11:57.637770       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.638916       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0915 19:11:57.640203       1 timeout.go:135] post-timeout activity - time-elapsed: 31.371334ms, POST "/api/v1/namespaces/default/events" result: <nil>

	I0915 19:11:57.641167       1 trace.go:205] Trace[1143014761]: "Create" url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:bb3c2312-8930-436b-870a-91869178ba4a,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:54.844) (total time: 2796ms):

	Trace[1143014761]: [2.796835127s] [2.796835127s] END

	E0915 19:11:57.641259       1 timeout.go:135] post-timeout activity - time-elapsed: 32.032015ms, POST "/api/v1/namespaces/kube-system/pods" result: <nil>

	E0915 19:11:57.642472       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout

	I0915 19:11:57.643605       1 trace.go:205] Trace[137628608]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:0e2bebaf-ce34-4283-89d7-b9b51c771f61,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:56.470) (total time: 1173ms):

	Trace[137628608]: [1.173147509s] [1.173147509s] END

	E0915 19:11:57.643697       1 timeout.go:135] post-timeout activity - time-elapsed: 34.342272ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/storage-provisioner/token" result: <nil>

	I0915 19:11:57.644701       1 trace.go:205] Trace[840664150]: "Create" url:/api/v1/namespaces/kube-system/serviceaccounts/kube-proxy/token,user-agent:kubelet/v1.22.1 (linux/amd64) kubernetes/632ed30,audit-id:8be84463-647a-4c66-8e45-50f775e917ef,client:192.168.58.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (15-Sep-2021 19:11:56.069) (total time: 1574ms):

	Trace[840664150]: [1.574755248s] [1.574755248s] END

	E0915 19:11:57.644778       1 timeout.go:135] post-timeout activity - time-elapsed: 35.255523ms, POST "/api/v1/namespaces/kube-system/serviceaccounts/kube-proxy/token" result: <nil>

	E0915 19:11:57.648324       1 timeout.go:135] post-timeout activity - time-elapsed: 38.851875ms, GET "/api/v1/nodes/pause-20210915191040-306161" result: <nil>

	* ==> kube-controller-manager [a5f849b43b1c] <==

	* I0915 19:11:37.411967       1 shared_informer.go:247] Caches are synced for deployment

	I0915 19:11:37.414182       1 shared_informer.go:247] Caches are synced for PVC protection

	I0915 19:11:37.420105       1 shared_informer.go:247] Caches are synced for job

	I0915 19:11:37.425007       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring

	I0915 19:11:37.438253       1 shared_informer.go:247] Caches are synced for cronjob

	I0915 19:11:37.438264       1 shared_informer.go:247] Caches are synced for HPA

	I0915 19:11:37.438289       1 shared_informer.go:247] Caches are synced for certificate-csrapproving

	I0915 19:11:37.438302       1 shared_informer.go:247] Caches are synced for attach detach

	I0915 19:11:37.438587       1 shared_informer.go:247] Caches are synced for service account

	I0915 19:11:37.438657       1 shared_informer.go:247] Caches are synced for expand

	I0915 19:11:37.462666       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator

	I0915 19:11:37.523114       1 shared_informer.go:247] Caches are synced for resource quota

	I0915 19:11:37.530198       1 shared_informer.go:247] Caches are synced for daemon sets

	I0915 19:11:37.538172       1 shared_informer.go:247] Caches are synced for resource quota

	I0915 19:11:37.544233       1 shared_informer.go:247] Caches are synced for stateful set

	I0915 19:11:37.601354       1 shared_informer.go:247] Caches are synced for persistent volume

	I0915 19:11:38.046450       1 shared_informer.go:247] Caches are synced for garbage collector

	I0915 19:11:38.110631       1 shared_informer.go:247] Caches are synced for garbage collector

	I0915 19:11:38.110664       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0915 19:11:38.127841       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I0915 19:11:38.332278       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-m4kfv"

	I0915 19:11:38.429572       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-wgdfl"

	I0915 19:11:38.437471       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-fvrsb"

	I0915 19:11:38.578331       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I0915 19:11:38.582612       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-fvrsb"

	* ==> kube-proxy [d15f2b587bbf] <==

	* I0915 19:11:39.363141       1 node.go:172] Successfully retrieved node IP: 192.168.58.2

	I0915 19:11:39.363213       1 server_others.go:140] Detected node IP 192.168.58.2

	W0915 19:11:39.363234       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I0915 19:11:39.600471       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0915 19:11:39.600519       1 server_others.go:212] Using iptables Proxier.

	I0915 19:11:39.600534       1 server_others.go:219] creating dualStackProxier for iptables.

	W0915 19:11:39.600550       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0915 19:11:39.600893       1 server.go:649] Version: v1.22.1

	I0915 19:11:39.601741       1 config.go:315] Starting service config controller

	I0915 19:11:39.601782       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0915 19:11:39.601802       1 config.go:224] Starting endpoint slice config controller

	I0915 19:11:39.601807       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	E0915 19:11:39.608834       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pause-20210915191040-306161.16a5149bd9fff3a7", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048af3ae3db7be0, ext:474764259, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-pause-20210915191040-306161", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"pause

-20210915191040-306161", UID:"pause-20210915191040-306161", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "pause-20210915191040-306161.16a5149bd9fff3a7" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)

	I0915 19:11:39.703082       1 shared_informer.go:247] Caches are synced for endpoint slice config

	I0915 19:11:39.703101       1 shared_informer.go:247] Caches are synced for service config

	* ==> kube-scheduler [b2b6bdeb15b9] <==

	* E0915 19:11:22.694638       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:11:22.702299       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0915 19:11:22.702435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:11:22.702528       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.702603       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0915 19:11:22.702702       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:11:22.702774       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0915 19:11:22.702846       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.702958       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:11:22.703036       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:11:22.703110       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.703205       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:11:22.703278       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:22.703421       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:11:22.703439       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:11:23.563383       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:11:23.568607       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:11:23.616199       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:23.625013       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:11:23.682990       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:11:23.688603       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:11:23.721201       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:11:23.744652       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:11:23.777627       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	I0915 19:11:26.574973       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Wed 2021-09-15 19:10:43 UTC, end at Wed 2021-09-15 19:12:28 UTC. --

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895407    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/87e207cf7ed458dc963e57311bee91a6-etcd-certs\") pod \"etcd-pause-20210915191040-306161\" (UID: \"87e207cf7ed458dc963e57311bee91a6\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895438    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-usr-share-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895463    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/7de1da23176b119dfecc95ecb61dd307-etc-ca-certificates\") pod \"kube-controller-manager-pause-20210915191040-306161\" (UID: \"7de1da23176b119dfecc95ecb61dd307\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895490    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/7de1da23176b119dfecc95ecb61dd307-kubeconfig\") pod \"kube-controller-manager-pause-20210915191040-306161\" (UID: \"7de1da23176b119dfecc95ecb61dd307\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895515    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/87e207cf7ed458dc963e57311bee91a6-etcd-data\") pod \"etcd-pause-20210915191040-306161\" (UID: \"87e207cf7ed458dc963e57311bee91a6\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895541    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-etc-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895566    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-k8s-certs\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:54 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:54.895594    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b43c2d1987c2753ab3b743454432ec65-usr-local-share-ca-certificates\") pod \"kube-apiserver-pause-20210915191040-306161\" (UID: \"b43c2d1987c2753ab3b743454432ec65\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.468719    4310 apiserver.go:52] "Watching apiserver"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.472864    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.473029    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.473090    4310 topology_manager.go:200] "Topology Admit Handler"

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499643    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xmq\" (UniqueName: \"kubernetes.io/projected/6ec6737e-98cf-42bd-a911-9c89db377921-kube-api-access-r9xmq\") pod \"storage-provisioner\" (UID: \"6ec6737e-98cf-42bd-a911-9c89db377921\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499775    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/136bb615-a920-412f-b4ce-fdeeb75acfcb-xtables-lock\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499812    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/6ec6737e-98cf-42bd-a911-9c89db377921-tmp\") pod \"storage-provisioner\" (UID: \"6ec6737e-98cf-42bd-a911-9c89db377921\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499841    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/136bb615-a920-412f-b4ce-fdeeb75acfcb-kube-proxy\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499868    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh642\" (UniqueName: \"kubernetes.io/projected/136bb615-a920-412f-b4ce-fdeeb75acfcb-kube-api-access-sh642\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499900    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf5qs\" (UniqueName: \"kubernetes.io/projected/1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83-kube-api-access-tf5qs\") pod \"coredns-78fcd69978-wgdfl\" (UID: \"1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499929    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/136bb615-a920-412f-b4ce-fdeeb75acfcb-lib-modules\") pod \"kube-proxy-m4kfv\" (UID: \"136bb615-a920-412f-b4ce-fdeeb75acfcb\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499956    4310 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83-config-volume\") pod \"coredns-78fcd69978-wgdfl\" (UID: \"1943d8e5-e7a1-4ef8-b68c-ba0f3b37df83\") "

	Sep 15 19:11:55 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:55.499971    4310 reconciler.go:157] "Reconciler: start to sync state"

	Sep 15 19:11:57 pause-20210915191040-306161 kubelet[4310]: I0915 19:11:57.602522    4310 dynamic_cafile_content.go:170] "Shutting down controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: kubelet.service: Succeeded.

	Sep 15 19:11:57 pause-20210915191040-306161 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

	* ==> storage-provisioner [bba215ebb412] <==

	* I0915 19:11:51.762405       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0915 19:11:51.771218       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0915 19:11:51.771251       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0915 19:11:51.787868       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0915 19:11:51.788000       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b!

	I0915 19:11:51.788045       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"4cc154c3-2477-4781-8800-3bd0adce3c8a", APIVersion:"v1", ResourceVersion:"488", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b became leader

	I0915 19:11:51.888127       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_pause-20210915191040-306161_cd66c3a2-5e14-4c9a-b16d-648567d27e6b!

-- /stdout --

** stderr **

	E0915 19:12:27.765104  490169 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	Unable to connect to the server: net/http: TLS handshake timeout

	 output: "\n** stderr ** \nUnable to connect to the server: net/http: TLS handshake timeout\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:250: failed logs error: exit status 110

--- FAIL: TestPause/serial/PauseAgain (32.32s)

–

TestStartStop/group/embed-certs/serial/Pause (6.52s)

=== RUN   TestStartStop/group/embed-certs/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-20210915191735-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p embed-certs-20210915191735-306161 --alsologtostderr -v=1: exit status 80 (2.270740954s)

-- stdout --

	* Pausing node embed-certs-20210915191735-306161 ...

-- /stdout --

** stderr **

	I0915 19:28:30.710225  671980 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:28:30.710439  671980 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:28:30.710447  671980 out.go:311] Setting ErrFile to fd 2...

	I0915 19:28:30.710453  671980 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:28:30.710546  671980 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:28:30.710704  671980 out.go:305] Setting JSON to false

	I0915 19:28:30.710729  671980 mustload.go:65] Loading cluster: embed-certs-20210915191735-306161

	I0915 19:28:30.711004  671980 config.go:177] Loaded profile config "embed-certs-20210915191735-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 19:28:30.711359  671980 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:30.752999  671980 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:30.753288  671980 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:28:30.836772  671980 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2021-09-15 19:28:30.790991501 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:28:30.837505  671980 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cni: container-runtime:docker cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=

true) host-only-cidr:192.168.99.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/12425/minikube-v1.23.0-1631662909-12425.iso https://github.com/kubernetes/minikube/releases/download/v1.23.0-1631662909-12425/minikube-v1.23.0-1631662909-12425.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.23.0-1631662909-12425.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: memory: mount:%!s(bool=false) mount-string:/home/jenkins:/minikube-host namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plu

gin: nfs-share:[] nfs-shares-root:/nfsshares no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:embed-certs-20210915191735-306161 purge:%!s(bool=false) registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) schedule:0s service-cluster-ip-range:10.96.0.0/12 ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I0915 19:28:30.840233  671980 out.go:177] * Pausing node embed-certs-20210915191735-306161 ...

	I0915 19:28:30.840267  671980 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:30.840528  671980 ssh_runner.go:152] Run: systemctl --version

	I0915 19:28:30.840566  671980 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:30.883847  671980 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:30.960950  671980 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:30.970042  671980 pause.go:50] kubelet running: true

	I0915 19:28:30.970107  671980 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet

	I0915 19:28:31.099640  671980 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	I0915 19:28:31.376112  671980 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:31.385835  671980 pause.go:50] kubelet running: true

	I0915 19:28:31.385894  671980 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet

	I0915 19:28:31.489977  671980 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	I0915 19:28:32.030719  671980 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:32.040367  671980 pause.go:50] kubelet running: true

	I0915 19:28:32.040456  671980 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet

	I0915 19:28:32.147523  671980 retry.go:31] will retry after 655.06503ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	I0915 19:28:32.803361  671980 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:32.813531  671980 pause.go:50] kubelet running: true

	I0915 19:28:32.813596  671980 ssh_runner.go:152] Run: sudo systemctl disable --now kubelet

	I0915 19:28:32.922161  671980 out.go:177]

	W0915 19:28:32.922307  671980 out.go:242] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	W0915 19:28:32.922322  671980 out.go:242] *

	W0915 19:28:32.928160  671980 out.go:242] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log                   │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0915 19:28:32.929485  671980 out.go:177]

** /stderr **

start_stop_delete_test.go:296: out/minikube-linux-amd64 pause -p embed-certs-20210915191735-306161 --alsologtostderr -v=1 failed: exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Pause]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect embed-certs-20210915191735-306161

helpers_test.go:236: (dbg) docker inspect embed-certs-20210915191735-306161:

-- stdout --

	        "Id": "8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8",

	        "Created": "2021-09-15T19:21:00.903642467Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 630615,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-09-15T19:22:46.495356131Z",

	            "FinishedAt": "2021-09-15T19:22:44.988186115Z"

},

	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",

	        "ResolvConfPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/hostname",

	        "HostsPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/hosts",

	        "LogPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8-json.log",

	        "Name": "/embed-certs-20210915191735-306161",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "embed-certs-20210915191735-306161:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "embed-certs-20210915191735-306161",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67-init/diff:/var/lib/docker/overlay2/42af7561be1bbb04e60d5898b29ceee8cccacce1c1e5ac5a5471bd2c2eb199c1/diff:/var/lib/docker/overlay2/751fc28b4872d1d49285c85a1cc36b03020834feb891b324f4934fc7bbb2a6ad/diff:/var/lib/docker/overlay2/0ecc58bf735cb0b519ef22a62daf0e530d708564e0b5e2a32c0d2dfbf82c31f1/diff:/var/lib/docker/overlay2/40f6c03795cd703755126d403a243ddfa2b5a61c04ba64a54188be2d675512f0/diff:/var/lib/docker/overlay2/c1ed82aa36dccda427851e6e631dda57f4ea197ec647ed726ad163b6ab37743f/diff:/var/lib/docker/overlay2/80d741d1e18c6360d99304165056959acb58e58f7c7d3b65d8d53565555b4030/diff:/var/lib/docker/overlay2/447eff9d25dbd151310c8d31d34423f404bc92869252861a8515d52575670208/diff:/var/lib/docker/overlay2/c0772139dfb4023aacb541a406a5e5d1697bd07fb74faf19f0f70c0378a6a0aa/diff:/var/lib/docker/overlay2/b6bb35ea8704143c911f2f148b8a83fb1595e56bdb785ad83f7f5b0ba255050b/diff:/var/lib/docker/overlay2/77cfc0

f9841fd241edda977799472f43ff62c670f7f0dc94936630ed52e1b91e/diff:/var/lib/docker/overlay2/47450527f7ce6a152d348dbe5dac4026cc11f3f715cf7e7b7ea7e797df3f5cf4/diff:/var/lib/docker/overlay2/5ea3e2569f810895df6596566930f3068e5c5d42831d6bda8de83d19c1185d3f/diff:/var/lib/docker/overlay2/d116c54fdfbaac2c30c98b1317c22640c46f07f3f9924da3e450e7cc3f026f3b/diff:/var/lib/docker/overlay2/4f1d2222e5e679ccc39dcf8be0e0caad5028cf91c0cc32b4025b79da0530cf79/diff:/var/lib/docker/overlay2/d395fbc24d899f00e3584b6298d4b2d46f9c834636fa54bf82aec3d8bf7aa1e4/diff:/var/lib/docker/overlay2/a294a18c3929a26e58691a4f489d1d4ed51d12a1c252dc68fdee0b9bddededd1/diff:/var/lib/docker/overlay2/8bba47552514f0de9059dcaf0fac98e702505d70e78a52d0394a82f5fc85fa37/diff:/var/lib/docker/overlay2/020c4987317db46a4f9cdc01cf984f014ead8756b3e1c340fb8f181a80339c1c/diff:/var/lib/docker/overlay2/a9def08cecacaa841f943f37f2b4027d2b8c9c6b2a0e55d4844d2c257eddd0e6/diff:/var/lib/docker/overlay2/17ef9dd7c4c56b129b7bcdf2629184e963776cba2a5484bd18ca3102b68d02cc/diff:/var/lib/d

ocker/overlay2/8d91d9e3464303a35c2d8a3a3f93f0ab30cd9fe6fa28c942ddc92769cf590ac9/diff:/var/lib/docker/overlay2/9830b73f3f06b9fc4f470e3b1dc16b8a3299272056c5131a298e6bb42a083941/diff:/var/lib/docker/overlay2/ea9d596d994ea5dfd5a26427720cb2e8361d797aa279267428df94c19a9d7c44/diff:/var/lib/docker/overlay2/2e1466e09da2855871ebe76fbcffcb15fd134652525feb0105fe152a084d210e/diff:/var/lib/docker/overlay2/9bdc54e7df3f3e5c2597a98b2737c550e37e1f78d16859fb6518d8b440ca0b08/diff:/var/lib/docker/overlay2/5037f238f4a3fe4dab6cd163114a4e1ff421eac25c08e1692759c11df7b3ee16/diff:/var/lib/docker/overlay2/873666dc974cc73345c5bdf7408c32b17137d25cc199834ebd8660d05c9481e2/diff:/var/lib/docker/overlay2/139b02d97d4069f11d6bc3503baa4785c0a78b8bd7bc9cb27acaf894f3107aa9/diff:/var/lib/docker/overlay2/6e6fd6abdb501264791d7c049ecc9089ab221a7aa6f4cbb745874fefd93cf871/diff:/var/lib/docker/overlay2/11575ed178ccca3cb09dfeb7628b08e11e6a3357f3659c2890a288ce9f2ba782/diff:/var/lib/docker/overlay2/bb3435980235e05ccce2d74ef847a0acd46c4edf0d38983388b271aa9dd

b6053/diff:/var/lib/docker/overlay2/0e3e4464369c9a27193d7ad87e67c5485363aeabca8fcbc6855eab5789e4c2a5/diff:/var/lib/docker/overlay2/41e71fdf4be3041a17553878254d63ea1c8c4063994bf2725203012ee9dd93c5/diff:/var/lib/docker/overlay2/76ee62595a4ab520c3233836c68c0bc0297b3907fff6db1b659f16f4325b8d3c/diff:/var/lib/docker/overlay2/dc211f5ed531b1debbcdd38dd7129b846d5e959af10f3144da2541b5c6f0233b/diff:/var/lib/docker/overlay2/6822a79442f86fb63c1067f542f9f6ce9288d3cec3ed6330fce4a6e3f48db77e/diff:/var/lib/docker/overlay2/757fc4ce96317e0c241e2344c927a20f4844398da422284baf7de7aebb6f828f/diff:/var/lib/docker/overlay2/3672ef17e397e206ae409a53d2bca46c162142ff01c54c787ba59f0bf2dad58a/diff:/var/lib/docker/overlay2/e04f51cc901a2cc97f893a3d4c6ebb453df442a6d57974d1b702d6ad1efab159/diff",

	                "MergedDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/merged",

	                "UpperDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/diff",

	                "WorkDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "embed-certs-20210915191735-306161",

	                "Source": "/var/lib/docker/volumes/embed-certs-20210915191735-306161/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "embed-certs-20210915191735-306161",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "embed-certs-20210915191735-306161",

	                "name.minikube.sigs.k8s.io": "embed-certs-20210915191735-306161",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "478afb8929e7a34af7d9e963875fb943d23716421505f6efbaaf8ba61c93adc1",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33252"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33251"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33248"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33250"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33249"

},

	            "SandboxKey": "/var/run/docker/netns/478afb8929e7",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "embed-certs-20210915191735-306161": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.76.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "8432ce9f1474"

],

	                    "NetworkID": "95d00192a37b7a165001c7ff8fa9c7cc0bc2c4d2f32fda4ad63f2e80b9848722",

	                    "EndpointID": "219c2c82f8e94bd18ff305363deafa8a3c4ad8945b585c4c2c10f77402b737e2",

	                    "Gateway": "192.168.76.1",

	                    "IPAddress": "192.168.76.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:4c:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

helpers_test.go:245: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20210915191735-306161 logs -n 25

E0915 19:28:34.297993  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

E0915 19:28:34.303290  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

E0915 19:28:34.314179  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

E0915 19:28:34.334502  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

E0915 19:28:34.374897  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-20210915191735-306161 logs -n 25: (1.066980181s)

E0915 19:28:34.456185  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:253: TestStartStop/group/embed-certs/serial/Pause logs:

-- stdout --

	* ==> Audit <==

	* |---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                            Args                            |                     Profile                      |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | -p                                                         | default-k8s-different-port-20210915191739-306161 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:44 UTC | Wed, 15 Sep 2021 19:24:47 UTC |

	|         | default-k8s-different-port-20210915191739-306161           |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | default-k8s-different-port-20210915191739-306161 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:47 UTC | Wed, 15 Sep 2021 19:24:47 UTC |

	|         | default-k8s-different-port-20210915191739-306161           |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:51 UTC | Wed, 15 Sep 2021 19:24:51 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:51 UTC | Wed, 15 Sep 2021 19:24:52 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:53 UTC | Wed, 15 Sep 2021 19:24:53 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:55 UTC | Wed, 15 Sep 2021 19:24:58 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:58 UTC | Wed, 15 Sep 2021 19:24:58 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	| start   | -p newest-cni-20210915192447-306161 --memory=2200          | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:47 UTC | Wed, 15 Sep 2021 19:25:24 UTC |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                  |         |         |                               |                               |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                  |         |         |                               |                               |

	|         | --driver=docker  --container-runtime=docker                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.2-rc.0                          |                                                  |         |         |                               |                               |

	| addons  | enable metrics-server -p                                   | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:24 UTC | Wed, 15 Sep 2021 19:25:30 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                  |         |         |                               |                               |

	|         | --registries=MetricsServer=fake.domain                     |                                                  |         |         |                               |                               |

	| stop    | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:30 UTC | Wed, 15 Sep 2021 19:25:41 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=3                                     |                                                  |         |         |                               |                               |

	| addons  | enable dashboard -p                                        | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:41 UTC | Wed, 15 Sep 2021 19:25:41 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                  |         |         |                               |                               |

	| start   | -p newest-cni-20210915192447-306161 --memory=2200          | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:41 UTC | Wed, 15 Sep 2021 19:26:02 UTC |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                  |         |         |                               |                               |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                  |         |         |                               |                               |

	|         | --driver=docker  --container-runtime=docker                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.2-rc.0                          |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:03 UTC | Wed, 15 Sep 2021 19:26:03 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:03 UTC | Wed, 15 Sep 2021 19:26:04 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:05 UTC | Wed, 15 Sep 2021 19:26:05 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:06 UTC | Wed, 15 Sep 2021 19:26:09 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:09 UTC | Wed, 15 Sep 2021 19:26:10 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	| start   | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:19 UTC | Wed, 15 Sep 2021 19:26:12 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                            |                                                  |         |         |                               |                               |

	|         | --wait=true --kvm-network=default                          |                                                  |         |         |                               |                               |

	|         | --kvm-qemu-uri=qemu:///system                              |                                                  |         |         |                               |                               |

	|         | --disable-driver-mounts                                    |                                                  |         |         |                               |                               |

	|         | --keep-context=false --driver=docker                       |                                                  |         |         |                               |                               |

	|         |  --container-runtime=docker                                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.14.0                               |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:23 UTC | Wed, 15 Sep 2021 19:26:23 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:23 UTC | Wed, 15 Sep 2021 19:26:24 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:25 UTC | Wed, 15 Sep 2021 19:26:25 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:26 UTC | Wed, 15 Sep 2021 19:26:29 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:29 UTC | Wed, 15 Sep 2021 19:26:29 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	| start   | -p                                                         | embed-certs-20210915191735-306161                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:45 UTC | Wed, 15 Sep 2021 19:28:19 UTC |

	|         | embed-certs-20210915191735-306161                          |                                                  |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                            |                                                  |         |         |                               |                               |

	|         | --wait=true --embed-certs                                  |                                                  |         |         |                               |                               |

	|         | --driver=docker                                            |                                                  |         |         |                               |                               |

	|         | --container-runtime=docker                                 |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.1                               |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | embed-certs-20210915191735-306161                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:28:30 UTC | Wed, 15 Sep 2021 19:28:30 UTC |

	|         | embed-certs-20210915191735-306161                          |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	|---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 19:25:41

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 19:25:41.862783  658499 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:25:41.862980  658499 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:25:41.862993  658499 out.go:311] Setting ErrFile to fd 2...

	I0915 19:25:41.862998  658499 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:25:41.863091  658499 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:25:41.863320  658499 out.go:305] Setting JSON to false

	I0915 19:25:41.899804  658499 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":18319,"bootTime":1631715623,"procs":294,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 19:25:41.899933  658499 start.go:121] virtualization: kvm guest

	I0915 19:25:41.902357  658499 out.go:177] * [newest-cni-20210915192447-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	I0915 19:25:41.904105  658499 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:25:41.902528  658499 notify.go:169] Checking for updates...

	I0915 19:25:41.905701  658499 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 19:25:41.907630  658499 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 19:25:41.909137  658499 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 19:25:41.909593  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:25:41.909961  658499 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 19:25:41.961897  658499 docker.go:132] docker version: linux-19.03.15

	I0915 19:25:41.962001  658499 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:25:42.048487  658499 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:25:41.99818945 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddre

ss:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warning

s:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:25:42.048614  658499 docker.go:237] overlay module found

	I0915 19:25:42.050806  658499 out.go:177] * Using the docker driver based on existing profile

	I0915 19:25:42.050844  658499 start.go:278] selected driver: docker

	I0915 19:25:42.050855  658499 start.go:751] validating driver "docker" against &{Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default A

PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa

:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:42.050974  658499 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 19:25:42.051015  658499 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:25:42.051037  658499 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:25:42.052580  658499 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:25:42.053487  658499 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:25:42.144392  658499 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:25:42.096976285 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W0915 19:25:42.144520  658499 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:25:42.144545  658499 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:25:42.147149  658499 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:25:42.147266  658499 start_flags.go:756] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]

	I0915 19:25:42.147293  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:25:42.147307  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:25:42.147316  658499 start_flags.go:278] config:

	{Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca

l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTime

out:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:42.149234  658499 out.go:177] * Starting control plane node newest-cni-20210915192447-306161 in cluster newest-cni-20210915192447-306161

	I0915 19:25:42.149272  658499 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 19:25:42.150659  658499 out.go:177] * Pulling base image ...

	I0915 19:25:42.150699  658499 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 19:25:42.150737  658499 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4

	I0915 19:25:42.150749  658499 cache.go:57] Caching tarball of preloaded images

	I0915 19:25:42.150792  658499 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	I0915 19:25:42.150924  658499 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0915 19:25:42.150945  658499 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.2-rc.0 on docker

	I0915 19:25:42.151065  658499 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/config.json ...

	I0915 19:25:42.240490  658499 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 19:25:42.240520  658499 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 19:25:42.240536  658499 cache.go:206] Successfully downloaded all kic artifacts

	I0915 19:25:42.240574  658499 start.go:313] acquiring machines lock for newest-cni-20210915192447-306161: {Name:mkad20b25b5784d0f84e18309f4272b093cdeaa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:25:42.240709  658499 start.go:317] acquired machines lock for "newest-cni-20210915192447-306161" in 73.966µs

	I0915 19:25:42.240730  658499 start.go:93] Skipping create...Using existing machine configuration

	I0915 19:25:42.240736  658499 fix.go:55] fixHost starting:

	I0915 19:25:42.241041  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:25:42.294709  658499 fix.go:108] recreateIfNeeded on newest-cni-20210915192447-306161: state=Stopped err=<nil>

	W0915 19:25:42.294745  658499 fix.go:134] unexpected machine state, will restart: <nil>

	I0915 19:25:43.801153  616226 system_pods.go:86] 4 kube-system pods found

	I0915 19:25:43.801192  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801200  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801211  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:25:43.801218  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801240  616226 retry.go:31] will retry after 6.062999549s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0915 19:25:40.747212  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:42.747244  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:44.748522  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:42.297203  658499 out.go:177] * Restarting existing docker container for "newest-cni-20210915192447-306161" ...

	I0915 19:25:42.297299  658499 cli_runner.go:115] Run: docker start newest-cni-20210915192447-306161

	I0915 19:25:43.603143  658499 cli_runner.go:168] Completed: docker start newest-cni-20210915192447-306161: (1.305799702s)

	I0915 19:25:43.603246  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:25:43.647964  658499 kic.go:420] container "newest-cni-20210915192447-306161" state is running.

	I0915 19:25:43.648365  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:43.690501  658499 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/config.json ...

	I0915 19:25:43.690724  658499 machine.go:88] provisioning docker machine ...

	I0915 19:25:43.690751  658499 ubuntu.go:169] provisioning hostname "newest-cni-20210915192447-306161"

	I0915 19:25:43.690799  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:43.733204  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:43.733382  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:43.733398  658499 main.go:130] libmachine: About to run SSH command:

	sudo hostname newest-cni-20210915192447-306161 && echo "newest-cni-20210915192447-306161" | sudo tee /etc/hostname

	I0915 19:25:43.733954  658499 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50686->127.0.0.1:33262: read: connection reset by peer

	I0915 19:25:46.853070  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: newest-cni-20210915192447-306161

	I0915 19:25:46.853148  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:46.894948  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:46.895098  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:46.895128  658499 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\snewest-cni-20210915192447-306161' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-20210915192447-306161/g' /etc/hosts;

				else

					echo '127.0.1.1 newest-cni-20210915192447-306161' | sudo tee -a /etc/hosts;

fi

fi

	I0915 19:25:47.004800  658499 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I0915 19:25:47.004832  658499 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem

ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube}

	I0915 19:25:47.004875  658499 ubuntu.go:177] setting up certificates

	I0915 19:25:47.004894  658499 provision.go:83] configureAuth start

	I0915 19:25:47.004990  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:47.047239  658499 provision.go:138] copyHostCerts

	I0915 19:25:47.047303  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem, removing ...

	I0915 19:25:47.047311  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem

	I0915 19:25:47.047375  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem (1082 bytes)

	I0915 19:25:47.047462  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem, removing ...

	I0915 19:25:47.047473  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem

	I0915 19:25:47.047495  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem (1123 bytes)

	I0915 19:25:47.047538  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem, removing ...

	I0915 19:25:47.047546  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem

	I0915 19:25:47.047564  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem (1679 bytes)

	I0915 19:25:47.047604  658499 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem org=jenkins.newest-cni-20210915192447-306161 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube newest-cni-20210915192447-306161]

	I0915 19:25:47.197750  658499 provision.go:172] copyRemoteCerts

	I0915 19:25:47.197824  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0915 19:25:47.197880  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.238735  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:47.320102  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0915 19:25:47.337336  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem --> /etc/docker/server.pem (1269 bytes)

	I0915 19:25:47.353207  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0915 19:25:47.371740  658499 provision.go:86] duration metric: configureAuth took 366.827461ms

	I0915 19:25:47.371776  658499 ubuntu.go:193] setting minikube options for container-runtime

	I0915 19:25:47.372000  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:25:47.372077  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.414543  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.414690  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.414702  658499 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0915 19:25:47.520964  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0915 19:25:47.520994  658499 ubuntu.go:71] root file system type: overlay

	I0915 19:25:47.521196  658499 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0915 19:25:47.521263  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.562788  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.562965  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.563056  658499 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0915 19:25:47.677388  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0915 19:25:47.677461  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.719250  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.719415  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.719438  658499 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0915 19:25:47.828262  658499 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I0915 19:25:47.828293  658499 machine.go:91] provisioned docker machine in 4.137553239s

	I0915 19:25:47.828303  658499 start.go:267] post-start starting for "newest-cni-20210915192447-306161" (driver="docker")

	I0915 19:25:47.828309  658499 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0915 19:25:47.828358  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0915 19:25:47.828398  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.871182  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:47.952488  658499 ssh_runner.go:152] Run: cat /etc/os-release

	I0915 19:25:47.955199  658499 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0915 19:25:47.955230  658499 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0915 19:25:47.955242  658499 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0915 19:25:47.955258  658499 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0915 19:25:47.955267  658499 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/addons for local assets ...

	I0915 19:25:47.955314  658499 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files for local assets ...

	I0915 19:25:47.955385  658499 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem -> 3061612.pem in /etc/ssl/certs

	I0915 19:25:47.955462  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs

	I0915 19:25:47.962422  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem --> /etc/ssl/certs/3061612.pem (1708 bytes)

	I0915 19:25:47.979389  658499 start.go:270] post-start completed in 151.070841ms

	I0915 19:25:47.979454  658499 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0915 19:25:47.979506  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.020710  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.097376  658499 fix.go:57] fixHost completed within 5.856630665s

	I0915 19:25:48.097410  658499 start.go:80] releasing machines lock for "newest-cni-20210915192447-306161", held for 5.856687371s

	I0915 19:25:48.097499  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:48.139804  658499 ssh_runner.go:152] Run: systemctl --version

	I0915 19:25:48.139834  658499 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0915 19:25:48.139856  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.139888  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.185273  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.185495  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.283966  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd

	I0915 19:25:48.296080  658499 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I0915 19:25:48.305533  658499 cruntime.go:255] skipping containerd shutdown because we are bound to it

	I0915 19:25:48.305588  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio

	I0915 19:25:48.314853  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0915 19:25:48.327248  658499 ssh_runner.go:152] Run: sudo systemctl unmask docker.service

	I0915 19:25:48.389002  658499 ssh_runner.go:152] Run: sudo systemctl enable docker.socket

	I0915 19:25:48.448063  658499 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I0915 19:25:48.458349  658499 ssh_runner.go:152] Run: sudo systemctl daemon-reload

	I0915 19:25:48.520830  658499 ssh_runner.go:152] Run: sudo systemctl start docker

	I0915 19:25:48.530199  658499 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I0915 19:25:48.570651  658499 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I0915 19:25:48.612524  658499 out.go:204] * Preparing Kubernetes v1.22.2-rc.0 on Docker 20.10.8 ...

	I0915 19:25:48.612641  658499 cli_runner.go:115] Run: docker network inspect newest-cni-20210915192447-306161 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0915 19:25:48.653897  658499 ssh_runner.go:152] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I0915 19:25:48.657395  658499 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0915 19:25:48.669044  658499 out.go:177]   - kubelet.network-plugin=cni

	I0915 19:25:47.247270  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:49.748668  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:48.670573  658499 out.go:177]   - kubeadm.pod-network-cidr=192.168.111.111/16

	I0915 19:25:48.670642  658499 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 19:25:48.670705  658499 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0915 19:25:48.703493  658499 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0

	k8s.gcr.io/kube-proxy:v1.22.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.22.2-rc.0

	k8s.gcr.io/etcd:3.5.0-0

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	kubernetesui/dashboard:v2.1.0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0915 19:25:48.703520  658499 docker.go:489] Images already preloaded, skipping extraction

	I0915 19:25:48.703576  658499 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0915 19:25:48.735443  658499 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.2-rc.0

	k8s.gcr.io/kube-proxy:v1.22.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.22.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0

	k8s.gcr.io/etcd:3.5.0-0

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	kubernetesui/dashboard:v2.1.0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0915 19:25:48.735471  658499 cache_images.go:78] Images are preloaded, skipping loading

	I0915 19:25:48.735524  658499 ssh_runner.go:152] Run: docker info --format {{.CgroupDriver}}

	I0915 19:25:48.819293  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:25:48.819321  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:25:48.819334  658499 kubeadm.go:87] Using pod CIDR: 192.168.111.111/16

	I0915 19:25:48.819352  658499 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:192.168.111.111/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.22.2-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-20210915192447-306161 NodeName:newest-cni-20210915192447-306161 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota feature-gates:ServerSideApply=true] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[feature-gates:ServerSideApply=true leader-ele

ct:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0915 19:25:48.819516  658499 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "newest-cni-20210915192447-306161"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	    feature-gates: "ServerSideApply=true"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    feature-gates: "ServerSideApply=true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    feature-gates: "ServerSideApply=true"

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.2-rc.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "192.168.111.111/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "192.168.111.111/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0915 19:25:48.819637  658499 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.2-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --feature-gates=ServerSideApply=true --hostname-override=newest-cni-20210915192447-306161 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0915 19:25:48.819701  658499 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.2-rc.0

	I0915 19:25:48.826905  658499 binaries.go:44] Found k8s binaries, skipping transfer

	I0915 19:25:48.826962  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0915 19:25:48.833503  658499 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (421 bytes)

	I0915 19:25:48.845544  658499 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0915 19:25:48.857211  658499 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2216 bytes)

	I0915 19:25:48.868646  658499 ssh_runner.go:152] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0915 19:25:48.871419  658499 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0915 19:25:48.879958  658499 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161 for IP: 192.168.49.2

	I0915 19:25:48.880009  658499 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key

	I0915 19:25:48.880029  658499 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key

	I0915 19:25:48.880071  658499 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/client.key

	I0915 19:25:48.880092  658499 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.key.dd3b5fb2

	I0915 19:25:48.880115  658499 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.key

	I0915 19:25:48.880215  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161.pem (1338 bytes)

	W0915 19:25:48.880258  658499 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161_empty.pem, impossibly tiny 0 bytes

	I0915 19:25:48.880268  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem (1675 bytes)

	I0915 19:25:48.880287  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem (1082 bytes)

	I0915 19:25:48.880310  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem (1123 bytes)

	I0915 19:25:48.880331  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem (1679 bytes)

	I0915 19:25:48.880367  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem (1708 bytes)

	I0915 19:25:48.881320  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0915 19:25:48.897344  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0915 19:25:48.914139  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0915 19:25:48.930086  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0915 19:25:48.946075  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0915 19:25:48.961655  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0915 19:25:48.977354  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0915 19:25:48.993503  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0915 19:25:49.009904  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem --> /usr/share/ca-certificates/3061612.pem (1708 bytes)

	I0915 19:25:49.026113  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0915 19:25:49.043021  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161.pem --> /usr/share/ca-certificates/306161.pem (1338 bytes)

	I0915 19:25:49.061573  658499 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0915 19:25:49.073850  658499 ssh_runner.go:152] Run: openssl version

	I0915 19:25:49.078544  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0915 19:25:49.085704  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.088711  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Sep 15 18:42 /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.088759  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.093785  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0915 19:25:49.100637  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/306161.pem && ln -fs /usr/share/ca-certificates/306161.pem /etc/ssl/certs/306161.pem"

	I0915 19:25:49.108425  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.111547  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Sep 15 18:46 /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.111594  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.116371  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/306161.pem /etc/ssl/certs/51391683.0"

	I0915 19:25:49.123177  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3061612.pem && ln -fs /usr/share/ca-certificates/3061612.pem /etc/ssl/certs/3061612.pem"

	I0915 19:25:49.130420  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.133341  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Sep 15 18:46 /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.133389  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.137932  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3061612.pem /etc/ssl/certs/3ec20f2e.0"

	I0915 19:25:49.144481  658499 kubeadm.go:390] StartCluster: {Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikub

eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false ku

belet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:49.144620  658499 ssh_runner.go:152] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:25:49.176829  658499 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0915 19:25:49.184357  658499 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0915 19:25:49.184376  658499 kubeadm.go:600] restartCluster start

	I0915 19:25:49.184416  658499 ssh_runner.go:152] Run: sudo test -d /data/minikube

	I0915 19:25:49.190753  658499 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.191584  658499 kubeconfig.go:117] verify returned: extract IP: "newest-cni-20210915192447-306161" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:25:49.191926  658499 kubeconfig.go:128] "newest-cni-20210915192447-306161" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig - will repair!

	I0915 19:25:49.192496  658499 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:25:49.194847  658499 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0915 19:25:49.201275  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.201320  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.214159  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.414567  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.414650  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.428453  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.614750  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.614841  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.629035  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.815239  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.815314  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.829487  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.014705  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.014793  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.028845  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.215109  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.215187  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.229570  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.414965  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.415056  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.429618  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.614721  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.614813  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.629424  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.814656  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.814748  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.828758  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.015075  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.015151  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.029653  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.214966  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.215043  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.229599  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.414905  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.415010  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.429681  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.614998  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.615093  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.629477  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.814735  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.868213  616226 system_pods.go:86] 5 kube-system pods found

	I0915 19:25:49.868243  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868249  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Pending

	I0915 19:25:49.868253  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868261  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:25:49.868266  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868283  616226 retry.go:31] will retry after 10.504197539s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0915 19:25:52.247783  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:54.748671  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:51.814879  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.830918  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.015132  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.015207  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.029416  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.214661  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.214764  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.228874  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.228893  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.228968  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.241592  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.241619  658499 kubeadm.go:575] needs reconfigure: apiserver error: timed out waiting for the condition

	I0915 19:25:52.241628  658499 kubeadm.go:1032] stopping kube-system containers ...

	I0915 19:25:52.241678  658499 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:25:52.326725  658499 docker.go:390] Stopping containers: [c179222cc03a ca89efd3bd43 6935f36879e1 2ac2f9892c63 a7566dbca80e 8990b45f27f2 9ef7104daa63 9a0297f799f6 000a541798ba 9923360704f0 e30bda4de2da f145142fe49d 416fe287f7ed 25ef2a9421bf abe4406c1e41 639e163b1a6c]

	I0915 19:25:52.326808  658499 ssh_runner.go:152] Run: docker stop c179222cc03a ca89efd3bd43 6935f36879e1 2ac2f9892c63 a7566dbca80e 8990b45f27f2 9ef7104daa63 9a0297f799f6 000a541798ba 9923360704f0 e30bda4de2da f145142fe49d 416fe287f7ed 25ef2a9421bf abe4406c1e41 639e163b1a6c

	I0915 19:25:52.362205  658499 ssh_runner.go:152] Run: sudo systemctl stop kubelet

	I0915 19:25:52.372252  658499 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0915 19:25:52.379153  658499 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5643 Sep 15 19:25 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 Sep 15 19:25 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2067 Sep 15 19:25 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Sep 15 19:25 /etc/kubernetes/scheduler.conf

	I0915 19:25:52.379207  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0915 19:25:52.385855  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0915 19:25:52.392314  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0915 19:25:52.398861  658499 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.398904  658499 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0915 19:25:52.405182  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0915 19:25:52.411600  658499 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.412794  658499 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0915 19:25:52.419500  658499 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0915 19:25:52.426531  658499 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0915 19:25:52.426554  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:52.474669  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.644110  658499 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.169399501s)

	I0915 19:25:53.644151  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.762117  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.819163  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.898887  658499 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:25:53.898957  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:54.415251  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:54.915247  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.414769  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.915033  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.933394  658499 api_server.go:70] duration metric: took 2.034507407s to wait for apiserver process to appear ...

	I0915 19:25:55.933424  658499 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:25:55.933436  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:25:57.247739  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:59.248011  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:59.514511  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0915 19:25:59.514540  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0915 19:26:00.015222  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:00.021129  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0915 19:26:00.021167  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0915 19:26:00.514670  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:00.519244  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0915 19:26:00.519274  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0915 19:26:01.014774  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:01.019564  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:

ok

	I0915 19:26:01.026375  658499 api_server.go:139] control plane version: v1.22.2-rc.0

	I0915 19:26:01.026397  658499 api_server.go:129] duration metric: took 5.092968284s to wait for apiserver health ...

	I0915 19:26:01.026409  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:26:01.026415  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:26:01.026423  658499 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:26:01.039605  658499 system_pods.go:59] 8 kube-system pods found

	I0915 19:26:01.039651  658499 system_pods.go:61] "coredns-78fcd69978-6vc5t" [4fc62da9-8a46-4e88-814b-0c76d25c9734] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0915 19:26:01.039660  658499 system_pods.go:61] "etcd-newest-cni-20210915192447-306161" [66265db3-03a5-460a-a582-040b20c0acb3] Running

	I0915 19:26:01.039677  658499 system_pods.go:61] "kube-apiserver-newest-cni-20210915192447-306161" [484dc944-d362-4284-aac4-741cd0a399a0] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0915 19:26:01.039688  658499 system_pods.go:61] "kube-controller-manager-newest-cni-20210915192447-306161" [21365108-04aa-41de-900b-1c01f35837f1] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0915 19:26:01.039695  658499 system_pods.go:61] "kube-proxy-xvwts" [e0adaced-8e5f-43d7-bdac-70078d101c80] Running

	I0915 19:26:01.039706  658499 system_pods.go:61] "kube-scheduler-newest-cni-20210915192447-306161" [b0ab4fca-c2bd-438d-b328-4bcbd11ac391] Running

	I0915 19:26:01.039714  658499 system_pods.go:61] "metrics-server-7c784ccb57-rj4cb" [f9a5652b-751d-4a11-8bf1-f1f8376c192b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:01.039730  658499 system_pods.go:61] "storage-provisioner" [f28d1a97-eb81-4e1d-a497-dc8774919d00] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0915 19:26:01.039740  658499 system_pods.go:74] duration metric: took 13.311777ms to wait for pod list to return data ...

	I0915 19:26:01.039752  658499 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:01.044529  658499 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:01.044624  658499 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:01.044647  658499 node_conditions.go:105] duration metric: took 4.889925ms to run NodePressure ...

	I0915 19:26:01.044670  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:26:01.525775  658499 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0915 19:26:01.603382  658499 ops.go:34] apiserver oom_adj: -16

	I0915 19:26:01.603418  658499 kubeadm.go:604] restartCluster took 12.419028009s

	I0915 19:26:01.603430  658499 kubeadm.go:392] StartCluster complete in 12.458955049s

	I0915 19:26:01.603452  658499 settings.go:142] acquiring lock: {Name:mk44303efdfafafe2d54d1fbe38c690da58db0c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:26:01.603562  658499 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:26:01.604993  658499 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:26:01.610402  658499 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "newest-cni-20210915192447-306161" rescaled to 1

	I0915 19:26:01.610464  658499 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}

	I0915 19:26:01.610498  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0915 19:26:01.612396  658499 out.go:177] * Verifying Kubernetes components...

	I0915 19:26:01.610593  658499 addons.go:404] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0915 19:26:01.612464  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:26:01.612493  658499 addons.go:65] Setting storage-provisioner=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612519  658499 addons.go:153] Setting addon storage-provisioner=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612526  658499 addons.go:165] addon storage-provisioner should already be in state true

	I0915 19:26:01.612558  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.612570  658499 addons.go:65] Setting dashboard=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612592  658499 addons.go:153] Setting addon dashboard=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612601  658499 addons.go:165] addon dashboard should already be in state true

	I0915 19:26:01.612606  658499 addons.go:65] Setting default-storageclass=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612620  658499 addons.go:65] Setting metrics-server=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612632  658499 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-20210915192447-306161"

	I0915 19:26:01.612637  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.612641  658499 addons.go:153] Setting addon metrics-server=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612651  658499 addons.go:165] addon metrics-server should already be in state true

	I0915 19:26:01.612677  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.613056  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.613143  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.610707  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:26:01.613228  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.613306  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.674162  658499 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0915 19:26:01.674222  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0915 19:26:01.674230  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0915 19:26:01.674285  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.676199  658499 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0915 19:26:01.677645  658499 out.go:177]   - Using image kubernetesui/dashboard:v2.1.0

	I0915 19:26:01.678904  658499 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0915 19:26:01.677695  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0915 19:26:01.678961  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0915 19:26:01.679012  658499 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:26:01.679027  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0915 19:26:01.679033  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.679069  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.705034  658499 addons.go:153] Setting addon default-storageclass=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.705061  658499 addons.go:165] addon default-storageclass should already be in state true

	I0915 19:26:01.705092  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.705598  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.738733  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.739965  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.742106  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.767234  658499 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml

	I0915 19:26:01.767254  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0915 19:26:01.767300  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.815636  658499 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:26:01.817420  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:26:01.815706  658499 start.go:709] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0915 19:26:01.815780  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.848513  658499 api_server.go:70] duration metric: took 238.01851ms to wait for apiserver process to appear ...

	I0915 19:26:01.848543  658499 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:26:01.848556  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:01.894803  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:

ok

	I0915 19:26:01.895733  658499 api_server.go:139] control plane version: v1.22.2-rc.0

	I0915 19:26:01.895757  658499 api_server.go:129] duration metric: took 47.206532ms to wait for apiserver health ...

	I0915 19:26:01.895767  658499 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:26:01.901824  658499 system_pods.go:59] 8 kube-system pods found

	I0915 19:26:01.901862  658499 system_pods.go:61] "coredns-78fcd69978-6vc5t" [4fc62da9-8a46-4e88-814b-0c76d25c9734] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0915 19:26:01.901874  658499 system_pods.go:61] "etcd-newest-cni-20210915192447-306161" [66265db3-03a5-460a-a582-040b20c0acb3] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0915 19:26:01.901886  658499 system_pods.go:61] "kube-apiserver-newest-cni-20210915192447-306161" [484dc944-d362-4284-aac4-741cd0a399a0] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0915 19:26:01.901908  658499 system_pods.go:61] "kube-controller-manager-newest-cni-20210915192447-306161" [21365108-04aa-41de-900b-1c01f35837f1] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0915 19:26:01.901918  658499 system_pods.go:61] "kube-proxy-xvwts" [e0adaced-8e5f-43d7-bdac-70078d101c80] Running

	I0915 19:26:01.901933  658499 system_pods.go:61] "kube-scheduler-newest-cni-20210915192447-306161" [b0ab4fca-c2bd-438d-b328-4bcbd11ac391] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0915 19:26:01.901950  658499 system_pods.go:61] "metrics-server-7c784ccb57-rj4cb" [f9a5652b-751d-4a11-8bf1-f1f8376c192b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:01.901969  658499 system_pods.go:61] "storage-provisioner" [f28d1a97-eb81-4e1d-a497-dc8774919d00] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0915 19:26:01.901980  658499 system_pods.go:74] duration metric: took 6.207128ms to wait for pod list to return data ...

	I0915 19:26:01.901998  658499 default_sa.go:34] waiting for default service account to be created ...

	I0915 19:26:01.906057  658499 default_sa.go:45] found service account: "default"

	I0915 19:26:01.906077  658499 default_sa.go:55] duration metric: took 4.069606ms for default service account to be created ...

	I0915 19:26:01.906088  658499 kubeadm.go:547] duration metric: took 295.598588ms to wait for : map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] ...

	I0915 19:26:01.906115  658499 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:01.908289  658499 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:01.908311  658499 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:01.908326  658499 node_conditions.go:105] duration metric: took 2.205441ms to run NodePressure ...

	I0915 19:26:01.908337  658499 start.go:231] waiting for startup goroutines ...

	I0915 19:26:01.909436  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:26:01.910167  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0915 19:26:01.910184  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0915 19:26:01.911211  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0915 19:26:01.911224  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0915 19:26:01.923700  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0915 19:26:01.923722  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0915 19:26:01.924713  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0915 19:26:01.924734  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)

	I0915 19:26:01.995665  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:26:01.995691  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)

	I0915 19:26:02.000056  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0915 19:26:02.000079  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0915 19:26:02.041624  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0915 19:26:02.096993  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0915 19:26:02.097019  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0915 19:26:02.097554  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:26:02.121824  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0915 19:26:02.121858  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0915 19:26:02.219076  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0915 19:26:02.219103  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0915 19:26:02.313273  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0915 19:26:02.313307  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0915 19:26:02.413094  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0915 19:26:02.413137  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0915 19:26:02.505773  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:26:02.505801  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0915 19:26:02.520672  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:26:02.705901  658499 addons.go:375] Verifying addon metrics-server=true in "newest-cni-20210915192447-306161"

	I0915 19:26:02.907638  658499 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard

	I0915 19:26:02.907666  658499 addons.go:406] enableAddons completed in 1.297081165s

	I0915 19:26:02.956870  658499 start.go:462] kubectl: 1.20.5, cluster: 1.22.2-rc.0 (minor skew: 2)

	I0915 19:26:02.958889  658499 out.go:177]

	W0915 19:26:02.959057  658499 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.2-rc.0.

	I0915 19:26:02.960706  658499 out.go:177]   - Want kubectl v1.22.2-rc.0? Try 'minikube kubectl -- get pods -A'

	I0915 19:26:02.962354  658499 out.go:177] * Done! kubectl is now configured to use "newest-cni-20210915192447-306161" cluster and "default" namespace by default

	I0915 19:26:00.375999  616226 system_pods.go:86] 6 kube-system pods found

	I0915 19:26:00.376029  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376035  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376039  616226 system_pods.go:89] "kube-controller-manager-old-k8s-version-20210915191644-306161" [bdeb0721-165a-11ec-bbd7-02427fa71781] Pending

	I0915 19:26:00.376043  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376053  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:00.376057  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376077  616226 retry.go:31] will retry after 12.194240946s: missing components: etcd, kube-controller-manager, kube-scheduler

	I0915 19:26:01.750821  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:04.247491  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:06.247946  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:08.748002  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:12.577146  616226 system_pods.go:86] 8 kube-system pods found

	I0915 19:26:12.577178  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577184  616226 system_pods.go:89] "etcd-old-k8s-version-20210915191644-306161" [c4798b55-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577189  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577193  616226 system_pods.go:89] "kube-controller-manager-old-k8s-version-20210915191644-306161" [bdeb0721-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577197  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577203  616226 system_pods.go:89] "kube-scheduler-old-k8s-version-20210915191644-306161" [c2afb80a-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577213  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:12.577220  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577232  616226 system_pods.go:126] duration metric: took 59.17541112s to wait for k8s-apps to be running ...

	I0915 19:26:12.577266  616226 system_svc.go:44] waiting for kubelet service to be running ....

	I0915 19:26:12.577361  616226 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:26:12.587055  616226 system_svc.go:56] duration metric: took 9.780171ms WaitForService to wait for kubelet.

	I0915 19:26:12.587086  616226 kubeadm.go:547] duration metric: took 1m4.375805583s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0915 19:26:12.587109  616226 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:12.589395  616226 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:12.589414  616226 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:12.589427  616226 node_conditions.go:105] duration metric: took 2.311316ms to run NodePressure ...

	I0915 19:26:12.589438  616226 start.go:231] waiting for startup goroutines ...

	I0915 19:26:12.633073  616226 start.go:462] kubectl: 1.20.5, cluster: 1.14.0 (minor skew: 6)

	I0915 19:26:12.635246  616226 out.go:177]

	W0915 19:26:12.635424  616226 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.14.0.

	I0915 19:26:12.636879  616226 out.go:177]   - Want kubectl v1.14.0? Try 'minikube kubectl -- get pods -A'

	I0915 19:26:12.638502  616226 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-20210915191644-306161" cluster and "default" namespace by default

	I0915 19:26:10.748138  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:12.748288  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:15.247163  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:17.747317  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:20.247774  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:22.760200  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:25.247975  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:27.249625  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:29.747288  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:32.247204  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:34.248008  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:36.747942  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:39.247502  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:41.747739  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:44.247926  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:46.748057  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:48.748247  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:51.247885  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:53.747161  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:55.748183  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:58.249250  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:00.747639  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:02.747781  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:04.748187  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:07.247671  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:09.746250  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:10.242651  630339 pod_ready.go:81] duration metric: took 4m0.005329506s waiting for pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace to be "Ready" ...

	E0915 19:27:10.242680  630339 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace to be "Ready" (will not retry!)

	I0915 19:27:10.242705  630339 pod_ready.go:38] duration metric: took 4m6.433296781s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:27:10.242734  630339 kubeadm.go:604] restartCluster took 4m18.152274601s

	W0915 19:27:10.242869  630339 out.go:242] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	I0915 19:27:10.242903  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I0915 19:27:50.037209  630339 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (39.794285944s)

	I0915 19:27:50.037283  630339 ssh_runner.go:152] Run: sudo systemctl stop -f kubelet

	I0915 19:27:50.047448  630339 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:27:50.078023  630339 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0915 19:27:50.085196  630339 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver

	I0915 19:27:50.085266  630339 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0915 19:27:50.092152  630339 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0915 19:27:50.092199  630339 ssh_runner.go:243] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0915 19:27:50.611081  630339 out.go:204]   - Generating certificates and keys ...

	I0915 19:27:51.536655  630339 out.go:204]   - Booting up control plane ...

	I0915 19:28:00.115835  630339 out.go:204]   - Configuring RBAC rules ...

	I0915 19:28:00.529523  630339 cni.go:93] Creating CNI manager for ""

	I0915 19:28:00.529549  630339 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:28:00.529578  630339 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0915 19:28:00.529652  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.529696  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl label nodes minikube.k8s.io/version=v1.23.0 minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876 minikube.k8s.io/name=embed-certs-20210915191735-306161 minikube.k8s.io/updated_at=2021_09_15T19_28_00_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.803974  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.821740  630339 ops.go:34] apiserver oom_adj: -16

	I0915 19:28:01.435391  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:01.934873  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:02.434868  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:02.935381  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:03.435232  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:03.935356  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:04.435324  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:04.935377  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:05.435069  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:05.934949  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:06.435200  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:06.934921  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:07.435372  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:07.935041  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:08.435699  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:08.935259  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:09.435528  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:09.935682  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:10.435064  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:10.934937  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:11.435476  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:11.934809  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.434877  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.935451  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.993725  630339 kubeadm.go:985] duration metric: took 12.464137165s to wait for elevateKubeSystemPrivileges.

	I0915 19:28:12.993758  630339 kubeadm.go:392] StartCluster complete in 5m20.941946433s

	I0915 19:28:12.993783  630339 settings.go:142] acquiring lock: {Name:mk44303efdfafafe2d54d1fbe38c690da58db0c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:28:12.993884  630339 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:28:12.994705  630339 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:28:13.509662  630339 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20210915191735-306161" rescaled to 1

	I0915 19:28:13.509715  630339 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}

	I0915 19:28:13.511702  630339 out.go:177] * Verifying Kubernetes components...

	I0915 19:28:13.509779  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0915 19:28:13.509798  630339 addons.go:404] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0915 19:28:13.509982  630339 config.go:177] Loaded profile config "embed-certs-20210915191735-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 19:28:13.511808  630339 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511823  630339 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511837  630339 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:13.511845  630339 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20210915191735-306161"

	I0915 19:28:13.511845  630339 addons.go:65] Setting metrics-server=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511867  630339 addons.go:153] Setting addon metrics-server=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.511879  630339 addons.go:165] addon metrics-server should already be in state true

	I0915 19:28:13.511829  630339 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.511914  630339 addons.go:165] addon storage-provisioner should already be in state true

	I0915 19:28:13.511922  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.511944  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.511808  630339 addons.go:65] Setting dashboard=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.512015  630339 addons.go:153] Setting addon dashboard=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.512035  630339 addons.go:165] addon dashboard should already be in state true

	I0915 19:28:13.512081  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.512200  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512412  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512453  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512536  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.532167  630339 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20210915191735-306161" to be "Ready" ...

	I0915 19:28:13.549865  630339 node_ready.go:49] node "embed-certs-20210915191735-306161" has status "Ready":"True"

	I0915 19:28:13.549892  630339 node_ready.go:38] duration metric: took 17.682852ms waiting for node "embed-certs-20210915191735-306161" to be "Ready" ...

	I0915 19:28:13.549905  630339 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:28:13.556092  630339 pod_ready.go:78] waiting up to 6m0s for pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:13.577195  630339 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0915 19:28:13.577327  630339 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:28:13.577341  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0915 19:28:13.577396  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.579872  630339 out.go:177]   - Using image kubernetesui/dashboard:v2.1.0

	I0915 19:28:13.581454  630339 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0915 19:28:13.581602  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0915 19:28:13.581620  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0915 19:28:13.581720  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.584563  630339 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0915 19:28:13.584623  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0915 19:28:13.584648  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0915 19:28:13.584699  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.596909  630339 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.596971  630339 addons.go:165] addon default-storageclass should already be in state true

	I0915 19:28:13.597004  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.597508  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.616213  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0915 19:28:13.638070  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.640039  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.642485  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.662456  630339 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml

	I0915 19:28:13.662483  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0915 19:28:13.662531  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.714620  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.812451  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0915 19:28:13.812477  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0915 19:28:13.821318  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:28:13.823897  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0915 19:28:13.823925  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0915 19:28:13.898690  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0915 19:28:13.898717  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)

	I0915 19:28:13.907259  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0915 19:28:13.907287  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0915 19:28:13.912105  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:28:13.912127  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)

	I0915 19:28:13.921012  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0915 19:28:13.921041  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0915 19:28:13.926989  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:28:13.936598  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0915 19:28:13.936631  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0915 19:28:14.015522  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0915 19:28:14.015551  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0915 19:28:14.018644  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0915 19:28:14.115517  630339 start.go:729] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS

	I0915 19:28:14.194584  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0915 19:28:14.194617  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0915 19:28:14.217096  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0915 19:28:14.217130  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0915 19:28:14.316665  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0915 19:28:14.316696  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0915 19:28:14.413346  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:28:14.413376  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0915 19:28:14.514932  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:28:15.394297  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.467264727s)

	I0915 19:28:15.394348  630339 addons.go:375] Verifying addon metrics-server=true in "embed-certs-20210915191735-306161"

	I0915 19:28:15.394404  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.375735791s)

	I0915 19:28:15.604399  630339 pod_ready.go:102] pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace has status "Ready":"False"

	I0915 19:28:16.394257  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.879269229s)

	I0915 19:28:16.396287  630339 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard

	I0915 19:28:16.396326  630339 addons.go:406] enableAddons completed in 2.886542307s

	I0915 19:28:17.067421  630339 pod_ready.go:92] pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.067450  630339 pod_ready.go:81] duration metric: took 3.511327335s waiting for pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.067464  630339 pod_ready.go:78] waiting up to 6m0s for pod "coredns-78fcd69978-px476" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.578427  630339 pod_ready.go:92] pod "coredns-78fcd69978-px476" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.578453  630339 pod_ready.go:81] duration metric: took 510.98247ms waiting for pod "coredns-78fcd69978-px476" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.578463  630339 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.582752  630339 pod_ready.go:92] pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.582768  630339 pod_ready.go:81] duration metric: took 4.299472ms waiting for pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.582777  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.595950  630339 pod_ready.go:92] pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.595967  630339 pod_ready.go:81] duration metric: took 13.185045ms waiting for pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.595975  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.599777  630339 pod_ready.go:92] pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.599796  630339 pod_ready.go:81] duration metric: took 3.813897ms waiting for pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.599806  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jl2js" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.398806  630339 pod_ready.go:92] pod "kube-proxy-jl2js" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:18.398839  630339 pod_ready.go:81] duration metric: took 799.026276ms waiting for pod "kube-proxy-jl2js" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.398852  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.697147  630339 pod_ready.go:92] pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:18.697171  630339 pod_ready.go:81] duration metric: took 298.310603ms waiting for pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.697183  630339 pod_ready.go:38] duration metric: took 5.147262663s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:28:18.697205  630339 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:28:18.697252  630339 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:28:18.726887  630339 api_server.go:70] duration metric: took 5.217142756s to wait for apiserver process to appear ...

	I0915 19:28:18.726919  630339 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:28:18.726930  630339 api_server.go:239] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...

	I0915 19:28:18.732297  630339 api_server.go:265] https://192.168.76.2:8443/healthz returned 200:

ok

	I0915 19:28:18.733382  630339 api_server.go:139] control plane version: v1.22.1

	I0915 19:28:18.733403  630339 api_server.go:129] duration metric: took 6.47846ms to wait for apiserver health ...

	I0915 19:28:18.733413  630339 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:28:18.899491  630339 system_pods.go:59] 9 kube-system pods found

	I0915 19:28:18.899577  630339 system_pods.go:61] "coredns-78fcd69978-5pjmp" [19356400-6282-4116-befe-300046323eaf] Running

	I0915 19:28:18.899605  630339 system_pods.go:61] "coredns-78fcd69978-px476" [6901b347-d524-4c8d-af90-51218a7c60e3] Running

	I0915 19:28:18.899613  630339 system_pods.go:61] "etcd-embed-certs-20210915191735-306161" [ab6ea6f9-3826-4d35-bd42-462c48430dbd] Running

	I0915 19:28:18.899622  630339 system_pods.go:61] "kube-apiserver-embed-certs-20210915191735-306161" [605eea37-ce31-445d-a1a2-331fb32a32a0] Running

	I0915 19:28:18.899631  630339 system_pods.go:61] "kube-controller-manager-embed-certs-20210915191735-306161" [f9fa8d2d-9be7-4eb4-a5e4-69a1f33e96f0] Running

	I0915 19:28:18.899642  630339 system_pods.go:61] "kube-proxy-jl2js" [a04e856f-4e7a-4873-806d-db2617c30f5e] Running

	I0915 19:28:18.899651  630339 system_pods.go:61] "kube-scheduler-embed-certs-20210915191735-306161" [0658f192-94f7-436d-9186-581eddea2329] Running

	I0915 19:28:18.899663  630339 system_pods.go:61] "metrics-server-7c784ccb57-6vvgw" [c9bddd13-c75f-4655-a463-5bfa136761f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:28:18.899674  630339 system_pods.go:61] "storage-provisioner" [1d578d39-1dc6-43a1-bd66-ab97567d32f4] Running

	I0915 19:28:18.899686  630339 system_pods.go:74] duration metric: took 166.266204ms to wait for pod list to return data ...

	I0915 19:28:18.899699  630339 default_sa.go:34] waiting for default service account to be created ...

	I0915 19:28:19.065102  630339 default_sa.go:45] found service account: "default"

	I0915 19:28:19.065130  630339 default_sa.go:55] duration metric: took 165.422256ms for default service account to be created ...

	I0915 19:28:19.065142  630339 system_pods.go:116] waiting for k8s-apps to be running ...

	I0915 19:28:19.303052  630339 system_pods.go:86] 9 kube-system pods found

	I0915 19:28:19.303102  630339 system_pods.go:89] "coredns-78fcd69978-5pjmp" [19356400-6282-4116-befe-300046323eaf] Running

	I0915 19:28:19.303112  630339 system_pods.go:89] "coredns-78fcd69978-px476" [6901b347-d524-4c8d-af90-51218a7c60e3] Running

	I0915 19:28:19.303120  630339 system_pods.go:89] "etcd-embed-certs-20210915191735-306161" [ab6ea6f9-3826-4d35-bd42-462c48430dbd] Running

	I0915 19:28:19.303129  630339 system_pods.go:89] "kube-apiserver-embed-certs-20210915191735-306161" [605eea37-ce31-445d-a1a2-331fb32a32a0] Running

	I0915 19:28:19.303140  630339 system_pods.go:89] "kube-controller-manager-embed-certs-20210915191735-306161" [f9fa8d2d-9be7-4eb4-a5e4-69a1f33e96f0] Running

	I0915 19:28:19.303147  630339 system_pods.go:89] "kube-proxy-jl2js" [a04e856f-4e7a-4873-806d-db2617c30f5e] Running

	I0915 19:28:19.303153  630339 system_pods.go:89] "kube-scheduler-embed-certs-20210915191735-306161" [0658f192-94f7-436d-9186-581eddea2329] Running

	I0915 19:28:19.303161  630339 system_pods.go:89] "metrics-server-7c784ccb57-6vvgw" [c9bddd13-c75f-4655-a463-5bfa136761f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:28:19.303169  630339 system_pods.go:89] "storage-provisioner" [1d578d39-1dc6-43a1-bd66-ab97567d32f4] Running

	I0915 19:28:19.303177  630339 system_pods.go:126] duration metric: took 238.029892ms to wait for k8s-apps to be running ...

	I0915 19:28:19.303189  630339 system_svc.go:44] waiting for kubelet service to be running ....

	I0915 19:28:19.303229  630339 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:19.315273  630339 system_svc.go:56] duration metric: took 12.072777ms WaitForService to wait for kubelet.

	I0915 19:28:19.315304  630339 kubeadm.go:547] duration metric: took 5.805567866s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0915 19:28:19.315335  630339 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:28:19.496010  630339 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:28:19.496042  630339 node_conditions.go:123] node cpu capacity is 8

	I0915 19:28:19.496056  630339 node_conditions.go:105] duration metric: took 180.715079ms to run NodePressure ...

	I0915 19:28:19.496070  630339 start.go:231] waiting for startup goroutines ...

	I0915 19:28:19.546976  630339 start.go:462] kubectl: 1.20.5, cluster: 1.22.1 (minor skew: 2)

	I0915 19:28:19.551158  630339 out.go:177]

	W0915 19:28:19.551323  630339 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.1.

	I0915 19:28:19.553032  630339 out.go:177]   - Want kubectl v1.22.1? Try 'minikube kubectl -- get pods -A'

	I0915 19:28:19.554829  630339 out.go:177] * Done! kubectl is now configured to use "embed-certs-20210915191735-306161" cluster and "default" namespace by default

	* ==> Docker <==

	* -- Logs begin at Wed 2021-09-15 19:22:46 UTC, end at Wed 2021-09-15 19:28:33 UTC. --

	Sep 15 19:27:27 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:27.379480659Z" level=info msg="ignoring event" container=4c31d8e021d2202611f840c44cd13e658fd8a3512ea0cd5c72e60a464a8cdae4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:27 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:27.580497866Z" level=info msg="ignoring event" container=0bcfa338e2b36c8551b1622023e1a49e756a849f60b035b9ac59e36e7e6f19ba module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.685269003Z" level=info msg="Container b11aa5c2416fc148f8abd1b61250998ebdd83b86501a1349e8d0846acfcd6d65 failed to exit within 10 seconds of signal 15 - using the force"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.765940008Z" level=info msg="ignoring event" container=b11aa5c2416fc148f8abd1b61250998ebdd83b86501a1349e8d0846acfcd6d65 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.927652916Z" level=info msg="ignoring event" container=bd8cf098ba378d12ec990b16cade1d3c3c49aa2e0e4db6eff1f784d0bffc8b25 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.050101341Z" level=info msg="Container 9ad1922ac47a930e943058ee10ae7bd78a8b4c6e54289a0cbe58bdf3d75c0289 failed to exit within 10 seconds of signal 15 - using the force"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.139676793Z" level=info msg="ignoring event" container=9ad1922ac47a930e943058ee10ae7bd78a8b4c6e54289a0cbe58bdf3d75c0289 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.308200815Z" level=info msg="ignoring event" container=30eec8edd1cf762ffd11feb7d44d9ce48110af111f671840f2d8c938b88bb98a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.511562087Z" level=info msg="ignoring event" container=cffdd64547041cd6cbfd5ddae256f35c39a4dcbb73391ad69c6dc569745c3646 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.708067888Z" level=info msg="ignoring event" container=1379267275b562b1fb1bd304ebb18386d5df47a91059b097a1606fe4d15280ce module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.924261916Z" level=info msg="ignoring event" container=072a09912fc7d95c1fdc295f08d2d5aed9064d8a6aa422cfe60270d2f2317cbb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:15 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:15.396647319Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:28:15 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:15.398813317Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.831705608Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.831747780Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.895198551Z" level=error msg="Handler for POST /v1.41/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:17 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:17.570226113Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:17 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:17.736216910Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:21 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:21.944391345Z" level=info msg="ignoring event" container=4c08c98822f3a7096eb834043cf14326225b058e517c9919998fcfecc2271cbf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:22 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:22.072283155Z" level=info msg="ignoring event" container=7d0e1660b6830f0ceb46a5d8e182763c415317f769c08c599060519afaa8e55f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:22 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:22.408349267Z" level=info msg="ignoring event" container=efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:23.332421024Z" level=info msg="ignoring event" container=93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.627503342Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.627538813Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.629266188Z" level=error msg="Handler for POST /v1.41/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID

	93c4ffacad816       a90209bb39e3d       10 seconds ago      Exited              dashboard-metrics-scraper   1                   d31a5597e2cb1

	926d1a5f90de2       9a07b5b4bfac0       16 seconds ago      Running             kubernetes-dashboard        0                   56a8b0483f25b

	72e461c907466       6e38f40d628db       17 seconds ago      Running             storage-provisioner         0                   353c427191072

	5309ef9aced95       8d147537fb7d1       18 seconds ago      Running             coredns                     0                   e6aac42275d8f

	203aaff34a12b       36c4ebbc9d979       20 seconds ago      Running             kube-proxy                  0                   8b31122a1686f

	c1475065f3e44       6e002eb89a881       40 seconds ago      Running             kube-controller-manager     2                   d9a422d58e610

	8c7ea90597c12       aca5ededae9c8       40 seconds ago      Running             kube-scheduler              2                   e690b5dbf4bca

	e539ab7aa4c48       f30469a2491a5       40 seconds ago      Running             kube-apiserver              2                   80a6803d9e664

	9f09acec9e72c       0048118155842       40 seconds ago      Running             etcd                        2                   182f2862b9a19

	* ==> coredns [5309ef9aced9] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* Name:               embed-certs-20210915191735-306161

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=embed-certs-20210915191735-306161

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876

	                    minikube.k8s.io/name=embed-certs-20210915191735-306161

	                    minikube.k8s.io/updated_at=2021_09_15T19_28_00_0700

	                    minikube.k8s.io/version=v1.23.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 15 Sep 2021 19:27:57 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  embed-certs-20210915191735-306161

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 15 Sep 2021 19:28:31 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:28:10 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.76.2

	  Hostname:    embed-certs-20210915191735-306161

	Capacity:

	  cpu:                8

	  ephemeral-storage:  309568300Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32951360Ki

	  pods:               110

	Allocatable:

	  cpu:                8

	  ephemeral-storage:  309568300Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32951360Ki

	  pods:               110

	System Info:

	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca

	  System UUID:                c66d1e85-b803-40b4-ad10-2908790ed522

	  Boot ID:                    9576884f-b233-4069-9090-8df061dd5dc5

	  Kernel Version:             4.9.0-16-amd64

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.22.1

	  Kube-Proxy Version:         v1.22.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                         ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-78fcd69978-5pjmp                                     100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     21s

	  kube-system                 etcd-embed-certs-20210915191735-306161                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         33s

	  kube-system                 kube-apiserver-embed-certs-20210915191735-306161             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         33s

	  kube-system                 kube-controller-manager-embed-certs-20210915191735-306161    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         33s

	  kube-system                 kube-proxy-jl2js                                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         21s

	  kube-system                 kube-scheduler-embed-certs-20210915191735-306161             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         33s

	  kube-system                 metrics-server-7c784ccb57-6vvgw                              100m (1%!)(MISSING)     0 (0%!)(MISSING)      300Mi (0%!)(MISSING)       0 (0%!)(MISSING)         19s

	  kube-system                 storage-provisioner                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         20s

	  kubernetes-dashboard        dashboard-metrics-scraper-8685c45546-nm652                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         19s

	  kubernetes-dashboard        kubernetes-dashboard-6fcdf4f6d-7b96n                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         19s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                850m (10%!)(MISSING)  0 (0%!)(MISSING)

	  memory             470Mi (1%!)(MISSING)  170Mi (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From     Message

	  ----    ------                   ----               ----     -------

	  Normal  NodeHasSufficientMemory  42s (x4 over 42s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    42s (x4 over 42s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     42s (x3 over 42s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  42s                kubelet  Updated Node Allocatable limit across pods

	  Normal  Starting                 34s                kubelet  Starting kubelet.

	  Normal  NodeHasSufficientMemory  34s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    34s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     34s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             34s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  33s                kubelet  Updated Node Allocatable limit across pods

	  Normal  NodeReady                24s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeReady

	* ==> dmesg <==

	* [Sep15 19:18] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"

	[ +15.778187] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:21] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:22] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:24] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:25] IPv4: martian source 10.85.0.2 from 10.85.0.2, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 7e 39 d7 48 28 bc 08 06        ......~9.H(...

	[  +0.000005] IPv4: martian source 10.85.0.2 from 10.85.0.2, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 7e 39 d7 48 28 bc 08 06        ......~9.H(...

	[  +0.006377] IPv4: martian source 10.85.0.3 from 10.85.0.3, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 1e 57 83 56 c2 5c 08 06        .......W.V.\..

	[  +0.000003] IPv4: martian source 10.85.0.3 from 10.85.0.3, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 1e 57 83 56 c2 5c 08 06        .......W.V.\..

	[ +19.111963] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:26] IPv4: martian source 10.85.0.4 from 10.85.0.4, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff c2 01 36 ba 27 5b 08 06        ........6.'[..

	[  +0.000005] IPv4: martian source 10.85.0.4 from 10.85.0.4, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff c2 01 36 ba 27 5b 08 06        ........6.'[..

	[  +0.407875] IPv4: martian source 10.85.0.5 from 10.85.0.5, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 72 3d da 00 de a3 08 06        ......r=......

	[  +1.488405] IPv4: martian source 10.85.0.6 from 10.85.0.6, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 86 ff c8 b5 68 a2 08 06        ..........h...

	[  +0.004332] IPv4: martian source 10.85.0.7 from 10.85.0.7, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 92 e4 e8 a4 2e 43 08 06        ...........C..

	* ==> etcd [9f09acec9e72] <==

	* {"level":"info","ts":"2021-09-15T19:27:53.621Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 switched to configuration voters=(16896983918768216326)"}

	{"level":"info","ts":"2021-09-15T19:27:53.621Z","caller":"membership/cluster.go:393","msg":"added member","cluster-id":"6f20f2c4b2fb5f8a","local-member-id":"ea7e25599daad906","added-peer-id":"ea7e25599daad906","added-peer-peer-urls":["https://192.168.76.2:2380"]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:580","msg":"serving peer traffic","address":"192.168.76.2:2380"}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:552","msg":"cmux::serve","address":"192.168.76.2:2380"}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:276","msg":"now serving peer/client/metrics","local-member-id":"ea7e25599daad906","initial-advertise-peer-urls":["https://192.168.76.2:2380"],"listen-peer-urls":["https://192.168.76.2:2380"],"advertise-client-urls":["https://192.168.76.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.76.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 is starting a new election at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became pre-candidate at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 received MsgPreVoteResp from ea7e25599daad906 at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became candidate at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became leader at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","caller":"etcdserver/server.go:2476","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"membership/cluster.go:531","msg":"set initial cluster version","cluster-id":"6f20f2c4b2fb5f8a","local-member-id":"ea7e25599daad906","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdserver/server.go:2500","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"ea7e25599daad906","local-member-attributes":"{Name:embed-certs-20210915191735-306161 ClientURLs:[https://192.168.76.2:2379]}","request-path":"/0/members/ea7e25599daad906/attributes","cluster-id":"6f20f2c4b2fb5f8a","publish-timeout":"7s"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-09-15T19:27:54.118Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2021-09-15T19:27:54.118Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.76.2:2379"}

	* ==> kernel <==

	*  19:28:34 up  5:08,  0 users,  load average: 1.17, 2.76, 3.27

	Linux embed-certs-20210915191735-306161 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [e539ab7aa4c4] <==

	* I0915 19:27:57.495669       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0915 19:27:57.497020       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller

	I0915 19:27:57.497820       1 cache.go:39] Caches are synced for autoregister controller

	I0915 19:27:57.500018       1 shared_informer.go:247] Caches are synced for node_authorizer

	I0915 19:27:57.506342       1 controller.go:611] quota admission added evaluator for: namespaces

	I0915 19:27:58.371056       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0915 19:27:58.371089       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0915 19:27:58.377016       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000

	I0915 19:27:58.384266       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000

	I0915 19:27:58.384288       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0915 19:27:58.775499       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0915 19:27:58.825091       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0915 19:27:58.922876       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]

	I0915 19:27:58.923994       1 controller.go:611] quota admission added evaluator for: endpoints

	I0915 19:27:58.928334       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0915 19:27:59.424038       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0915 19:28:00.259875       1 controller.go:611] quota admission added evaluator for: deployments.apps

	I0915 19:28:00.321204       1 controller.go:611] quota admission added evaluator for: daemonsets.apps

	I0915 19:28:00.510414       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0915 19:28:13.128751       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0915 19:28:13.179178       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	W0915 19:28:17.834944       1 handler_proxy.go:104] no RequestInfo found in the context

	E0915 19:28:17.835033       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0915 19:28:17.835044       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	* ==> kube-controller-manager [c1475065f3e4] <==

	* I0915 19:28:15.007425       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-7c784ccb57-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"

	E0915 19:28:15.096593       1 replica_set.go:536] sync "kube-system/metrics-server-7c784ccb57" failed with pods "metrics-server-7c784ccb57-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found

	I0915 19:28:15.097815       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-7c784ccb57-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"

	I0915 19:28:15.109364       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-7c784ccb57-6vvgw"

	I0915 19:28:15.602075       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set dashboard-metrics-scraper-8685c45546 to 1"

	I0915 19:28:15.611771       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.616687       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.694827       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set kubernetes-dashboard-6fcdf4f6d to 1"

	E0915 19:28:15.703757       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.704433       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.710665       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.710963       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.710999       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.716268       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0915 19:28:15.794261       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0915 19:28:15.794420       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.794481       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.794507       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.800955       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.801040       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.810973       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.811058       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.901529       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-8685c45546-nm652"

	I0915 19:28:15.902672       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-6fcdf4f6d-7b96n"

	W0915 19:28:23.044049       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: EndpointSlice informer cache is out of date

	* ==> kube-proxy [203aaff34a12] <==

	* I0915 19:28:15.099571       1 node.go:172] Successfully retrieved node IP: 192.168.76.2

	I0915 19:28:15.100122       1 server_others.go:140] Detected node IP 192.168.76.2

	W0915 19:28:15.100180       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I0915 19:28:15.213522       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0915 19:28:15.213562       1 server_others.go:212] Using iptables Proxier.

	I0915 19:28:15.213577       1 server_others.go:219] creating dualStackProxier for iptables.

	W0915 19:28:15.213592       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0915 19:28:15.213952       1 server.go:649] Version: v1.22.1

	I0915 19:28:15.214604       1 config.go:224] Starting endpoint slice config controller

	I0915 19:28:15.214622       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0915 19:28:15.214613       1 config.go:315] Starting service config controller

	I0915 19:28:15.214650       1 shared_informer.go:240] Waiting for caches to sync for service config

	E0915 19:28:15.221233       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"embed-certs-20210915191735-306161.16a51583a92831cd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048b033ccc9d5c6, ext:597927996, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-embed-certs-20210915191735-306161", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"",

Name:"embed-certs-20210915191735-306161", UID:"embed-certs-20210915191735-306161", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "embed-certs-20210915191735-306161.16a51583a92831cd" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)

	I0915 19:28:15.315668       1 shared_informer.go:247] Caches are synced for endpoint slice config

	I0915 19:28:15.326091       1 shared_informer.go:247] Caches are synced for service config

	* ==> kube-scheduler [8c7ea90597c1] <==

	* W0915 19:27:57.494947       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0915 19:27:57.517787       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I0915 19:27:57.517956       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0915 19:27:57.517984       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0915 19:27:57.518004       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E0915 19:27:57.598009       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:27:57.599178       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:27:57.601187       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:27:57.601189       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:27:57.601211       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:27:57.601349       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601363       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0915 19:27:57.601431       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:27:57.601533       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0915 19:27:57.601755       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:27:57.601797       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:27:57.601678       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0915 19:27:58.435738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:58.493388       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:27:58.502458       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:27:58.599251       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I0915 19:27:59.218079       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Wed 2021-09-15 19:22:46 UTC, end at Wed 2021-09-15 19:28:34 UTC. --

	Sep 15 19:28:18 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:18.936164    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/k8s.gcr.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-7c784ccb57-6vvgw" podUID=c9bddd13-c75f-4655-a463-5bfa136761f3

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.332486    5969 reconciler.go:196] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mptnz\" (UniqueName: \"kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz\") pod \"6901b347-d524-4c8d-af90-51218a7c60e3\" (UID: \"6901b347-d524-4c8d-af90-51218a7c60e3\") "

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.332551    5969 reconciler.go:196] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume\") pod \"6901b347-d524-4c8d-af90-51218a7c60e3\" (UID: \"6901b347-d524-4c8d-af90-51218a7c60e3\") "

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: W0915 19:28:22.332826    5969 empty_dir.go:517] Warning: Failed to clear quota on /var/lib/kubelet/pods/6901b347-d524-4c8d-af90-51218a7c60e3/volumes/kubernetes.io~configmap/config-volume: clearQuota called, but quotas disabled

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.333010    5969 operation_generator.go:866] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume" (OuterVolumeSpecName: "config-volume") pod "6901b347-d524-4c8d-af90-51218a7c60e3" (UID: "6901b347-d524-4c8d-af90-51218a7c60e3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue ""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.369404    5969 operation_generator.go:866] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz" (OuterVolumeSpecName: "kube-api-access-mptnz") pod "6901b347-d524-4c8d-af90-51218a7c60e3" (UID: "6901b347-d524-4c8d-af90-51218a7c60e3"). InnerVolumeSpecName "kube-api-access-mptnz". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.432782    5969 reconciler.go:319] "Volume detached for volume \"kube-api-access-mptnz\" (UniqueName: \"kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz\") on node \"embed-certs-20210915191735-306161\" DevicePath \"\""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.432826    5969 reconciler.go:319] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume\") on node \"embed-certs-20210915191735-306161\" DevicePath \"\""

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.012132    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.015341    5969 scope.go:110] "RemoveContainer" containerID="efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.020986    5969 scope.go:110] "RemoveContainer" containerID="4c08c98822f3a7096eb834043cf14326225b058e517c9919998fcfecc2271cbf"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.027950    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.032826    5969 scope.go:110] "RemoveContainer" containerID="efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.033070    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:24.033378    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.612869    5969 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=6901b347-d524-4c8d-af90-51218a7c60e3 path="/var/lib/kubelet/pods/6901b347-d524-4c8d-af90-51218a7c60e3/volumes"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:25.041811    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:25.044805    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:25.045089    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:26 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:26.052319    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:26 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:26.052576    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629679    5969 remote_image.go:114] "PullImage from image service failed" err="rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" image="fake.domain/k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629725    5969 kuberuntime_image.go:51] "Failed to pull image" err="rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" image="fake.domain/k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629881    5969 kuberuntime_manager.go:895] container &Container{Name:metrics-server,Image:fake.domain/k8s.gcr.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{314572800 0} {<nil>} 300Mi BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-xtfqw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handl

er{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez?exclude=readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz?exclude=livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]

VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-7c784ccb57-6vvgw_kube-system(c9bddd13-c75f-4655-a463-5bfa136761f3): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629946    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ErrImagePull: \"rpc error: code = Unknown desc = Error response from daemon: Get \\\"https://fake.domain/v2/\\\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host\"" pod="kube-system/metrics-server-7c784ccb57-6vvgw" podUID=c9bddd13-c75f-4655-a463-5bfa136761f3

	* ==> kubernetes-dashboard [926d1a5f90de] <==

	* 2021/09/15 19:28:17 Starting overwatch

	2021/09/15 19:28:17 Using namespace: kubernetes-dashboard

	2021/09/15 19:28:17 Using in-cluster config to connect to apiserver

	2021/09/15 19:28:17 Using secret token for csrf signing

	2021/09/15 19:28:17 Initializing csrf token from kubernetes-dashboard-csrf secret

	2021/09/15 19:28:17 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2021/09/15 19:28:17 Successful initial request to the apiserver, version: v1.22.1

	2021/09/15 19:28:17 Generating JWE encryption key

	2021/09/15 19:28:17 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2021/09/15 19:28:17 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2021/09/15 19:28:17 Initializing JWE encryption key from synchronized object

	2021/09/15 19:28:17 Creating in-cluster Sidecar client

	2021/09/15 19:28:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2021/09/15 19:28:17 Serving insecurely on HTTP port: 9090

	* ==> storage-provisioner [72e461c90746] <==

	* I0915 19:28:16.719493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0915 19:28:16.728848       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0915 19:28:16.728896       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0915 19:28:16.736662       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0915 19:28:16.736810       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e!

	I0915 19:28:16.736811       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e70b1b5b-46a1-4b63-bdb1-82009463c3cf", APIVersion:"v1", ResourceVersion:"568", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e became leader

	I0915 19:28:16.893114       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

E0915 19:28:34.616570  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:262: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

E0915 19:28:34.936978  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:271: non-running pods: metrics-server-7c784ccb57-6vvgw

helpers_test.go:273: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw: exit status 1 (85.495982ms)

** stderr **

	Error from server (NotFound): pods "metrics-server-7c784ccb57-6vvgw" not found

** /stderr **

helpers_test.go:278: kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw: exit status 1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Pause]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect embed-certs-20210915191735-306161

helpers_test.go:236: (dbg) docker inspect embed-certs-20210915191735-306161:

-- stdout --

	        "Id": "8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8",

	        "Created": "2021-09-15T19:21:00.903642467Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 630615,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-09-15T19:22:46.495356131Z",

	            "FinishedAt": "2021-09-15T19:22:44.988186115Z"

},

	        "Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",

	        "ResolvConfPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/hostname",

	        "HostsPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/hosts",

	        "LogPath": "/var/lib/docker/containers/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8/8432ce9f14741a63078e8367abbb02eee6266dd4113cc2762fbbfbbef8373fd8-json.log",

	        "Name": "/embed-certs-20210915191735-306161",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "embed-certs-20210915191735-306161:/var"

],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

},

	            "NetworkMode": "embed-certs-20210915191735-306161",

	            "PortBindings": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

},

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

},

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "Capabilities": null,

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

},

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

0,

],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

},

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67-init/diff:/var/lib/docker/overlay2/42af7561be1bbb04e60d5898b29ceee8cccacce1c1e5ac5a5471bd2c2eb199c1/diff:/var/lib/docker/overlay2/751fc28b4872d1d49285c85a1cc36b03020834feb891b324f4934fc7bbb2a6ad/diff:/var/lib/docker/overlay2/0ecc58bf735cb0b519ef22a62daf0e530d708564e0b5e2a32c0d2dfbf82c31f1/diff:/var/lib/docker/overlay2/40f6c03795cd703755126d403a243ddfa2b5a61c04ba64a54188be2d675512f0/diff:/var/lib/docker/overlay2/c1ed82aa36dccda427851e6e631dda57f4ea197ec647ed726ad163b6ab37743f/diff:/var/lib/docker/overlay2/80d741d1e18c6360d99304165056959acb58e58f7c7d3b65d8d53565555b4030/diff:/var/lib/docker/overlay2/447eff9d25dbd151310c8d31d34423f404bc92869252861a8515d52575670208/diff:/var/lib/docker/overlay2/c0772139dfb4023aacb541a406a5e5d1697bd07fb74faf19f0f70c0378a6a0aa/diff:/var/lib/docker/overlay2/b6bb35ea8704143c911f2f148b8a83fb1595e56bdb785ad83f7f5b0ba255050b/diff:/var/lib/docker/overlay2/77cfc0

f9841fd241edda977799472f43ff62c670f7f0dc94936630ed52e1b91e/diff:/var/lib/docker/overlay2/47450527f7ce6a152d348dbe5dac4026cc11f3f715cf7e7b7ea7e797df3f5cf4/diff:/var/lib/docker/overlay2/5ea3e2569f810895df6596566930f3068e5c5d42831d6bda8de83d19c1185d3f/diff:/var/lib/docker/overlay2/d116c54fdfbaac2c30c98b1317c22640c46f07f3f9924da3e450e7cc3f026f3b/diff:/var/lib/docker/overlay2/4f1d2222e5e679ccc39dcf8be0e0caad5028cf91c0cc32b4025b79da0530cf79/diff:/var/lib/docker/overlay2/d395fbc24d899f00e3584b6298d4b2d46f9c834636fa54bf82aec3d8bf7aa1e4/diff:/var/lib/docker/overlay2/a294a18c3929a26e58691a4f489d1d4ed51d12a1c252dc68fdee0b9bddededd1/diff:/var/lib/docker/overlay2/8bba47552514f0de9059dcaf0fac98e702505d70e78a52d0394a82f5fc85fa37/diff:/var/lib/docker/overlay2/020c4987317db46a4f9cdc01cf984f014ead8756b3e1c340fb8f181a80339c1c/diff:/var/lib/docker/overlay2/a9def08cecacaa841f943f37f2b4027d2b8c9c6b2a0e55d4844d2c257eddd0e6/diff:/var/lib/docker/overlay2/17ef9dd7c4c56b129b7bcdf2629184e963776cba2a5484bd18ca3102b68d02cc/diff:/var/lib/d

ocker/overlay2/8d91d9e3464303a35c2d8a3a3f93f0ab30cd9fe6fa28c942ddc92769cf590ac9/diff:/var/lib/docker/overlay2/9830b73f3f06b9fc4f470e3b1dc16b8a3299272056c5131a298e6bb42a083941/diff:/var/lib/docker/overlay2/ea9d596d994ea5dfd5a26427720cb2e8361d797aa279267428df94c19a9d7c44/diff:/var/lib/docker/overlay2/2e1466e09da2855871ebe76fbcffcb15fd134652525feb0105fe152a084d210e/diff:/var/lib/docker/overlay2/9bdc54e7df3f3e5c2597a98b2737c550e37e1f78d16859fb6518d8b440ca0b08/diff:/var/lib/docker/overlay2/5037f238f4a3fe4dab6cd163114a4e1ff421eac25c08e1692759c11df7b3ee16/diff:/var/lib/docker/overlay2/873666dc974cc73345c5bdf7408c32b17137d25cc199834ebd8660d05c9481e2/diff:/var/lib/docker/overlay2/139b02d97d4069f11d6bc3503baa4785c0a78b8bd7bc9cb27acaf894f3107aa9/diff:/var/lib/docker/overlay2/6e6fd6abdb501264791d7c049ecc9089ab221a7aa6f4cbb745874fefd93cf871/diff:/var/lib/docker/overlay2/11575ed178ccca3cb09dfeb7628b08e11e6a3357f3659c2890a288ce9f2ba782/diff:/var/lib/docker/overlay2/bb3435980235e05ccce2d74ef847a0acd46c4edf0d38983388b271aa9dd

b6053/diff:/var/lib/docker/overlay2/0e3e4464369c9a27193d7ad87e67c5485363aeabca8fcbc6855eab5789e4c2a5/diff:/var/lib/docker/overlay2/41e71fdf4be3041a17553878254d63ea1c8c4063994bf2725203012ee9dd93c5/diff:/var/lib/docker/overlay2/76ee62595a4ab520c3233836c68c0bc0297b3907fff6db1b659f16f4325b8d3c/diff:/var/lib/docker/overlay2/dc211f5ed531b1debbcdd38dd7129b846d5e959af10f3144da2541b5c6f0233b/diff:/var/lib/docker/overlay2/6822a79442f86fb63c1067f542f9f6ce9288d3cec3ed6330fce4a6e3f48db77e/diff:/var/lib/docker/overlay2/757fc4ce96317e0c241e2344c927a20f4844398da422284baf7de7aebb6f828f/diff:/var/lib/docker/overlay2/3672ef17e397e206ae409a53d2bca46c162142ff01c54c787ba59f0bf2dad58a/diff:/var/lib/docker/overlay2/e04f51cc901a2cc97f893a3d4c6ebb453df442a6d57974d1b702d6ad1efab159/diff",

	                "MergedDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/merged",

	                "UpperDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/diff",

	                "WorkDir": "/var/lib/docker/overlay2/103786db64cb65443a0439bdb5b50731ba4a6a7c1ba22b7730ff41ef1f392b67/work"

},

	            "Name": "overlay2"

},

	        "Mounts": [

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

},

	                "Type": "volume",

	                "Name": "embed-certs-20210915191735-306161",

	                "Source": "/var/lib/docker/volumes/embed-certs-20210915191735-306161/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

],

	        "Config": {

	            "Hostname": "embed-certs-20210915191735-306161",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

},

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "embed-certs-20210915191735-306161",

	                "name.minikube.sigs.k8s.io": "embed-certs-20210915191735-306161",

	                "role.minikube.sigs.k8s.io": ""

},

	            "StopSignal": "SIGRTMIN+3"

},

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "478afb8929e7a34af7d9e963875fb943d23716421505f6efbaaf8ba61c93adc1",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33252"

],

	                "2376/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33251"

],

	                "32443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33248"

],

	                "5000/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33250"

],

	                "8443/tcp": [

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33249"

},

	            "SandboxKey": "/var/run/docker/netns/478afb8929e7",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "embed-certs-20210915191735-306161": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.76.2"

},

	                    "Links": null,

	                    "Aliases": [

	                        "8432ce9f1474"

],

	                    "NetworkID": "95d00192a37b7a165001c7ff8fa9c7cc0bc2c4d2f32fda4ad63f2e80b9848722",

	                    "EndpointID": "219c2c82f8e94bd18ff305363deafa8a3c4ad8945b585c4c2c10f77402b737e2",

	                    "Gateway": "192.168.76.1",

	                    "IPAddress": "192.168.76.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:4c:02",

	                    "DriverOpts": null

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

helpers_test.go:245: <<< TestStartStop/group/embed-certs/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Pause]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-20210915191735-306161 logs -n 25

E0915 19:28:35.577220  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p embed-certs-20210915191735-306161 logs -n 25: (1.06691009s)

helpers_test.go:253: TestStartStop/group/embed-certs/serial/Pause logs:

-- stdout --

	* ==> Audit <==

	* |---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                            Args                            |                     Profile                      |  User   | Version |          Start Time           |           End Time            |

	|---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | -p                                                         | default-k8s-different-port-20210915191739-306161 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:47 UTC | Wed, 15 Sep 2021 19:24:47 UTC |

	|         | default-k8s-different-port-20210915191739-306161           |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:51 UTC | Wed, 15 Sep 2021 19:24:51 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:51 UTC | Wed, 15 Sep 2021 19:24:52 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:53 UTC | Wed, 15 Sep 2021 19:24:53 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:55 UTC | Wed, 15 Sep 2021 19:24:58 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | no-preload-20210915191727-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:58 UTC | Wed, 15 Sep 2021 19:24:58 UTC |

	|         | no-preload-20210915191727-306161                           |                                                  |         |         |                               |                               |

	| start   | -p newest-cni-20210915192447-306161 --memory=2200          | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:24:47 UTC | Wed, 15 Sep 2021 19:25:24 UTC |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                  |         |         |                               |                               |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                  |         |         |                               |                               |

	|         | --driver=docker  --container-runtime=docker                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.2-rc.0                          |                                                  |         |         |                               |                               |

	| addons  | enable metrics-server -p                                   | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:24 UTC | Wed, 15 Sep 2021 19:25:30 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                  |         |         |                               |                               |

	|         | --registries=MetricsServer=fake.domain                     |                                                  |         |         |                               |                               |

	| stop    | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:30 UTC | Wed, 15 Sep 2021 19:25:41 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=3                                     |                                                  |         |         |                               |                               |

	| addons  | enable dashboard -p                                        | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:41 UTC | Wed, 15 Sep 2021 19:25:41 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                  |         |         |                               |                               |

	| start   | -p newest-cni-20210915192447-306161 --memory=2200          | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:25:41 UTC | Wed, 15 Sep 2021 19:26:02 UTC |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                  |         |         |                               |                               |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                  |         |         |                               |                               |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                  |         |         |                               |                               |

	|         | --driver=docker  --container-runtime=docker                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.2-rc.0                          |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:03 UTC | Wed, 15 Sep 2021 19:26:03 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:03 UTC | Wed, 15 Sep 2021 19:26:04 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:05 UTC | Wed, 15 Sep 2021 19:26:05 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:06 UTC | Wed, 15 Sep 2021 19:26:09 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | newest-cni-20210915192447-306161                 | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:09 UTC | Wed, 15 Sep 2021 19:26:10 UTC |

	|         | newest-cni-20210915192447-306161                           |                                                  |         |         |                               |                               |

	| start   | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:19:19 UTC | Wed, 15 Sep 2021 19:26:12 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                            |                                                  |         |         |                               |                               |

	|         | --wait=true --kvm-network=default                          |                                                  |         |         |                               |                               |

	|         | --kvm-qemu-uri=qemu:///system                              |                                                  |         |         |                               |                               |

	|         | --disable-driver-mounts                                    |                                                  |         |         |                               |                               |

	|         | --keep-context=false --driver=docker                       |                                                  |         |         |                               |                               |

	|         |  --container-runtime=docker                                |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.14.0                               |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:23 UTC | Wed, 15 Sep 2021 19:26:23 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| pause   | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:23 UTC | Wed, 15 Sep 2021 19:26:24 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| unpause | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:25 UTC | Wed, 15 Sep 2021 19:26:25 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	|         | --alsologtostderr -v=1                                     |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:26 UTC | Wed, 15 Sep 2021 19:26:29 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	| delete  | -p                                                         | old-k8s-version-20210915191644-306161            | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:26:29 UTC | Wed, 15 Sep 2021 19:26:29 UTC |

	|         | old-k8s-version-20210915191644-306161                      |                                                  |         |         |                               |                               |

	| start   | -p                                                         | embed-certs-20210915191735-306161                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:22:45 UTC | Wed, 15 Sep 2021 19:28:19 UTC |

	|         | embed-certs-20210915191735-306161                          |                                                  |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr                            |                                                  |         |         |                               |                               |

	|         | --wait=true --embed-certs                                  |                                                  |         |         |                               |                               |

	|         | --driver=docker                                            |                                                  |         |         |                               |                               |

	|         | --container-runtime=docker                                 |                                                  |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.1                               |                                                  |         |         |                               |                               |

	| ssh     | -p                                                         | embed-certs-20210915191735-306161                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:28:30 UTC | Wed, 15 Sep 2021 19:28:30 UTC |

	|         | embed-certs-20210915191735-306161                          |                                                  |         |         |                               |                               |

	|         | sudo crictl images -o json                                 |                                                  |         |         |                               |                               |

	| -p      | embed-certs-20210915191735-306161                          | embed-certs-20210915191735-306161                | jenkins | v1.23.0 | Wed, 15 Sep 2021 19:28:33 UTC | Wed, 15 Sep 2021 19:28:34 UTC |

	|         | logs -n 25                                                 |                                                  |         |         |                               |                               |

	|---------|------------------------------------------------------------|--------------------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 19:25:41

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 19:25:41.862783  658499 out.go:298] Setting OutFile to fd 1 ...

	I0915 19:25:41.862980  658499 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:25:41.862993  658499 out.go:311] Setting ErrFile to fd 2...

	I0915 19:25:41.862998  658499 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 19:25:41.863091  658499 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 19:25:41.863320  658499 out.go:305] Setting JSON to false

	I0915 19:25:41.899804  658499 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":18319,"bootTime":1631715623,"procs":294,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 19:25:41.899933  658499 start.go:121] virtualization: kvm guest

	I0915 19:25:41.902357  658499 out.go:177] * [newest-cni-20210915192447-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	I0915 19:25:41.904105  658499 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:25:41.902528  658499 notify.go:169] Checking for updates...

	I0915 19:25:41.905701  658499 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 19:25:41.907630  658499 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 19:25:41.909137  658499 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 19:25:41.909593  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:25:41.909961  658499 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 19:25:41.961897  658499 docker.go:132] docker version: linux-19.03.15

	I0915 19:25:41.962001  658499 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:25:42.048487  658499 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:25:41.99818945 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddre

ss:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warning

s:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 19:25:42.048614  658499 docker.go:237] overlay module found

	I0915 19:25:42.050806  658499 out.go:177] * Using the docker driver based on existing profile

	I0915 19:25:42.050844  658499 start.go:278] selected driver: docker

	I0915 19:25:42.050855  658499 start.go:751] validating driver "docker" against &{Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default A

PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa

:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:42.050974  658499 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 19:25:42.051015  658499 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:25:42.051037  658499 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:25:42.052580  658499 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:25:42.053487  658499 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 19:25:42.144392  658499 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 19:25:42.096976285 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	W0915 19:25:42.144520  658499 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 19:25:42.144545  658499 out.go:242] ! Your cgroup does not allow setting memory.

	I0915 19:25:42.147149  658499 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 19:25:42.147266  658499 start_flags.go:756] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]

	I0915 19:25:42.147293  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:25:42.147307  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:25:42.147316  658499 start_flags.go:278] config:

	{Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca

l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTime

out:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:42.149234  658499 out.go:177] * Starting control plane node newest-cni-20210915192447-306161 in cluster newest-cni-20210915192447-306161

	I0915 19:25:42.149272  658499 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 19:25:42.150659  658499 out.go:177] * Pulling base image ...

	I0915 19:25:42.150699  658499 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 19:25:42.150737  658499 preload.go:147] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4

	I0915 19:25:42.150749  658499 cache.go:57] Caching tarball of preloaded images

	I0915 19:25:42.150792  658499 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	I0915 19:25:42.150924  658499 preload.go:173] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0915 19:25:42.150945  658499 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.2-rc.0 on docker

	I0915 19:25:42.151065  658499 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/config.json ...

	I0915 19:25:42.240490  658499 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 19:25:42.240520  658499 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 19:25:42.240536  658499 cache.go:206] Successfully downloaded all kic artifacts

	I0915 19:25:42.240574  658499 start.go:313] acquiring machines lock for newest-cni-20210915192447-306161: {Name:mkad20b25b5784d0f84e18309f4272b093cdeaa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0915 19:25:42.240709  658499 start.go:317] acquired machines lock for "newest-cni-20210915192447-306161" in 73.966µs

	I0915 19:25:42.240730  658499 start.go:93] Skipping create...Using existing machine configuration

	I0915 19:25:42.240736  658499 fix.go:55] fixHost starting:

	I0915 19:25:42.241041  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:25:42.294709  658499 fix.go:108] recreateIfNeeded on newest-cni-20210915192447-306161: state=Stopped err=<nil>

	W0915 19:25:42.294745  658499 fix.go:134] unexpected machine state, will restart: <nil>

	I0915 19:25:43.801153  616226 system_pods.go:86] 4 kube-system pods found

	I0915 19:25:43.801192  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801200  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801211  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:25:43.801218  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:43.801240  616226 retry.go:31] will retry after 6.062999549s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0915 19:25:40.747212  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:42.747244  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:44.748522  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:42.297203  658499 out.go:177] * Restarting existing docker container for "newest-cni-20210915192447-306161" ...

	I0915 19:25:42.297299  658499 cli_runner.go:115] Run: docker start newest-cni-20210915192447-306161

	I0915 19:25:43.603143  658499 cli_runner.go:168] Completed: docker start newest-cni-20210915192447-306161: (1.305799702s)

	I0915 19:25:43.603246  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:25:43.647964  658499 kic.go:420] container "newest-cni-20210915192447-306161" state is running.

	I0915 19:25:43.648365  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:43.690501  658499 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/config.json ...

	I0915 19:25:43.690724  658499 machine.go:88] provisioning docker machine ...

	I0915 19:25:43.690751  658499 ubuntu.go:169] provisioning hostname "newest-cni-20210915192447-306161"

	I0915 19:25:43.690799  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:43.733204  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:43.733382  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:43.733398  658499 main.go:130] libmachine: About to run SSH command:

	sudo hostname newest-cni-20210915192447-306161 && echo "newest-cni-20210915192447-306161" | sudo tee /etc/hostname

	I0915 19:25:43.733954  658499 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50686->127.0.0.1:33262: read: connection reset by peer

	I0915 19:25:46.853070  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: newest-cni-20210915192447-306161

	I0915 19:25:46.853148  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:46.894948  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:46.895098  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:46.895128  658499 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\snewest-cni-20210915192447-306161' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-20210915192447-306161/g' /etc/hosts;

				else

					echo '127.0.1.1 newest-cni-20210915192447-306161' | sudo tee -a /etc/hosts;

fi

fi

	I0915 19:25:47.004800  658499 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I0915 19:25:47.004832  658499 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem

ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube}

	I0915 19:25:47.004875  658499 ubuntu.go:177] setting up certificates

	I0915 19:25:47.004894  658499 provision.go:83] configureAuth start

	I0915 19:25:47.004990  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:47.047239  658499 provision.go:138] copyHostCerts

	I0915 19:25:47.047303  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem, removing ...

	I0915 19:25:47.047311  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem

	I0915 19:25:47.047375  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.pem (1082 bytes)

	I0915 19:25:47.047462  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem, removing ...

	I0915 19:25:47.047473  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem

	I0915 19:25:47.047495  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cert.pem (1123 bytes)

	I0915 19:25:47.047538  658499 exec_runner.go:145] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem, removing ...

	I0915 19:25:47.047546  658499 exec_runner.go:208] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem

	I0915 19:25:47.047564  658499 exec_runner.go:152] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/key.pem (1679 bytes)

	I0915 19:25:47.047604  658499 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem org=jenkins.newest-cni-20210915192447-306161 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube newest-cni-20210915192447-306161]

	I0915 19:25:47.197750  658499 provision.go:172] copyRemoteCerts

	I0915 19:25:47.197824  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0915 19:25:47.197880  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.238735  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:47.320102  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0915 19:25:47.337336  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server.pem --> /etc/docker/server.pem (1269 bytes)

	I0915 19:25:47.353207  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0915 19:25:47.371740  658499 provision.go:86] duration metric: configureAuth took 366.827461ms

	I0915 19:25:47.371776  658499 ubuntu.go:193] setting minikube options for container-runtime

	I0915 19:25:47.372000  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:25:47.372077  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.414543  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.414690  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.414702  658499 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0915 19:25:47.520964  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0915 19:25:47.520994  658499 ubuntu.go:71] root file system type: overlay

	I0915 19:25:47.521196  658499 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0915 19:25:47.521263  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.562788  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.562965  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.563056  658499 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0915 19:25:47.677388  658499 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0915 19:25:47.677461  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.719250  658499 main.go:130] libmachine: Using SSH client type: native

	I0915 19:25:47.719415  658499 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x7a1c40] 0x7a4d20 <nil>  [] 0s} 127.0.0.1 33262 <nil> <nil>}

	I0915 19:25:47.719438  658499 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0915 19:25:47.828262  658499 main.go:130] libmachine: SSH cmd err, output: <nil>:

	I0915 19:25:47.828293  658499 machine.go:91] provisioned docker machine in 4.137553239s

	I0915 19:25:47.828303  658499 start.go:267] post-start starting for "newest-cni-20210915192447-306161" (driver="docker")

	I0915 19:25:47.828309  658499 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0915 19:25:47.828358  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0915 19:25:47.828398  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:47.871182  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:47.952488  658499 ssh_runner.go:152] Run: cat /etc/os-release

	I0915 19:25:47.955199  658499 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0915 19:25:47.955230  658499 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0915 19:25:47.955242  658499 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0915 19:25:47.955258  658499 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0915 19:25:47.955267  658499 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/addons for local assets ...

	I0915 19:25:47.955314  658499 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files for local assets ...

	I0915 19:25:47.955385  658499 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem -> 3061612.pem in /etc/ssl/certs

	I0915 19:25:47.955462  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs

	I0915 19:25:47.962422  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem --> /etc/ssl/certs/3061612.pem (1708 bytes)

	I0915 19:25:47.979389  658499 start.go:270] post-start completed in 151.070841ms

	I0915 19:25:47.979454  658499 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0915 19:25:47.979506  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.020710  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.097376  658499 fix.go:57] fixHost completed within 5.856630665s

	I0915 19:25:48.097410  658499 start.go:80] releasing machines lock for "newest-cni-20210915192447-306161", held for 5.856687371s

	I0915 19:25:48.097499  658499 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915192447-306161

	I0915 19:25:48.139804  658499 ssh_runner.go:152] Run: systemctl --version

	I0915 19:25:48.139834  658499 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0915 19:25:48.139856  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.139888  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:25:48.185273  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.185495  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:25:48.283966  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd

	I0915 19:25:48.296080  658499 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I0915 19:25:48.305533  658499 cruntime.go:255] skipping containerd shutdown because we are bound to it

	I0915 19:25:48.305588  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio

	I0915 19:25:48.314853  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0915 19:25:48.327248  658499 ssh_runner.go:152] Run: sudo systemctl unmask docker.service

	I0915 19:25:48.389002  658499 ssh_runner.go:152] Run: sudo systemctl enable docker.socket

	I0915 19:25:48.448063  658499 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I0915 19:25:48.458349  658499 ssh_runner.go:152] Run: sudo systemctl daemon-reload

	I0915 19:25:48.520830  658499 ssh_runner.go:152] Run: sudo systemctl start docker

	I0915 19:25:48.530199  658499 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I0915 19:25:48.570651  658499 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I0915 19:25:48.612524  658499 out.go:204] * Preparing Kubernetes v1.22.2-rc.0 on Docker 20.10.8 ...

	I0915 19:25:48.612641  658499 cli_runner.go:115] Run: docker network inspect newest-cni-20210915192447-306161 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0915 19:25:48.653897  658499 ssh_runner.go:152] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I0915 19:25:48.657395  658499 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0915 19:25:48.669044  658499 out.go:177]   - kubelet.network-plugin=cni

	I0915 19:25:47.247270  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:49.748668  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:48.670573  658499 out.go:177]   - kubeadm.pod-network-cidr=192.168.111.111/16

	I0915 19:25:48.670642  658499 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 19:25:48.670705  658499 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0915 19:25:48.703493  658499 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0

	k8s.gcr.io/kube-proxy:v1.22.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.22.2-rc.0

	k8s.gcr.io/etcd:3.5.0-0

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	kubernetesui/dashboard:v2.1.0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0915 19:25:48.703520  658499 docker.go:489] Images already preloaded, skipping extraction

	I0915 19:25:48.703576  658499 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0915 19:25:48.735443  658499 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.2-rc.0

	k8s.gcr.io/kube-proxy:v1.22.2-rc.0

	k8s.gcr.io/kube-scheduler:v1.22.2-rc.0

	k8s.gcr.io/kube-controller-manager:v1.22.2-rc.0

	k8s.gcr.io/etcd:3.5.0-0

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	kubernetesui/dashboard:v2.1.0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0915 19:25:48.735471  658499 cache_images.go:78] Images are preloaded, skipping loading

	I0915 19:25:48.735524  658499 ssh_runner.go:152] Run: docker info --format {{.CgroupDriver}}

	I0915 19:25:48.819293  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:25:48.819321  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:25:48.819334  658499 kubeadm.go:87] Using pod CIDR: 192.168.111.111/16

	I0915 19:25:48.819352  658499 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:192.168.111.111/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.22.2-rc.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-20210915192447-306161 NodeName:newest-cni-20210915192447-306161 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota feature-gates:ServerSideApply=true] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[feature-gates:ServerSideApply=true leader-ele

ct:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0915 19:25:48.819516  658499 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "newest-cni-20210915192447-306161"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	    feature-gates: "ServerSideApply=true"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    feature-gates: "ServerSideApply=true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    feature-gates: "ServerSideApply=true"

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.2-rc.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "192.168.111.111/16"

	  serviceSubnet: 10.96.0.0/12

---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "192.168.111.111/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0915 19:25:48.819637  658499 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.2-rc.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --feature-gates=ServerSideApply=true --hostname-override=newest-cni-20210915192447-306161 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0915 19:25:48.819701  658499 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.2-rc.0

	I0915 19:25:48.826905  658499 binaries.go:44] Found k8s binaries, skipping transfer

	I0915 19:25:48.826962  658499 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0915 19:25:48.833503  658499 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (421 bytes)

	I0915 19:25:48.845544  658499 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0915 19:25:48.857211  658499 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2216 bytes)

	I0915 19:25:48.868646  658499 ssh_runner.go:152] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0915 19:25:48.871419  658499 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0915 19:25:48.879958  658499 certs.go:52] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161 for IP: 192.168.49.2

	I0915 19:25:48.880009  658499 certs.go:179] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key

	I0915 19:25:48.880029  658499 certs.go:179] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key

	I0915 19:25:48.880071  658499 certs.go:293] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/client.key

	I0915 19:25:48.880092  658499 certs.go:293] skipping minikube signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.key.dd3b5fb2

	I0915 19:25:48.880115  658499 certs.go:293] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.key

	I0915 19:25:48.880215  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161.pem (1338 bytes)

	W0915 19:25:48.880258  658499 certs.go:372] ignoring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161_empty.pem, impossibly tiny 0 bytes

	I0915 19:25:48.880268  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca-key.pem (1675 bytes)

	I0915 19:25:48.880287  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/ca.pem (1082 bytes)

	I0915 19:25:48.880310  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/cert.pem (1123 bytes)

	I0915 19:25:48.880331  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/key.pem (1679 bytes)

	I0915 19:25:48.880367  658499 certs.go:376] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem (1708 bytes)

	I0915 19:25:48.881320  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0915 19:25:48.897344  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0915 19:25:48.914139  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0915 19:25:48.930086  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/newest-cni-20210915192447-306161/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0915 19:25:48.946075  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0915 19:25:48.961655  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0915 19:25:48.977354  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0915 19:25:48.993503  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0915 19:25:49.009904  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/ssl/certs/3061612.pem --> /usr/share/ca-certificates/3061612.pem (1708 bytes)

	I0915 19:25:49.026113  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0915 19:25:49.043021  658499 ssh_runner.go:319] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/certs/306161.pem --> /usr/share/ca-certificates/306161.pem (1338 bytes)

	I0915 19:25:49.061573  658499 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0915 19:25:49.073850  658499 ssh_runner.go:152] Run: openssl version

	I0915 19:25:49.078544  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0915 19:25:49.085704  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.088711  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Sep 15 18:42 /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.088759  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0915 19:25:49.093785  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0915 19:25:49.100637  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/306161.pem && ln -fs /usr/share/ca-certificates/306161.pem /etc/ssl/certs/306161.pem"

	I0915 19:25:49.108425  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.111547  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Sep 15 18:46 /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.111594  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/306161.pem

	I0915 19:25:49.116371  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/306161.pem /etc/ssl/certs/51391683.0"

	I0915 19:25:49.123177  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3061612.pem && ln -fs /usr/share/ca-certificates/3061612.pem /etc/ssl/certs/3061612.pem"

	I0915 19:25:49.130420  658499 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.133341  658499 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Sep 15 18:46 /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.133389  658499 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3061612.pem

	I0915 19:25:49.137932  658499 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3061612.pem /etc/ssl/certs/3ec20f2e.0"

	I0915 19:25:49.144481  658499 kubeadm.go:390] StartCluster: {Name:newest-cni-20210915192447-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915192447-306161 Namespace:default APIServerName:minikub

eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false ku

belet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 19:25:49.144620  658499 ssh_runner.go:152] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:25:49.176829  658499 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0915 19:25:49.184357  658499 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0915 19:25:49.184376  658499 kubeadm.go:600] restartCluster start

	I0915 19:25:49.184416  658499 ssh_runner.go:152] Run: sudo test -d /data/minikube

	I0915 19:25:49.190753  658499 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.191584  658499 kubeconfig.go:117] verify returned: extract IP: "newest-cni-20210915192447-306161" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:25:49.191926  658499 kubeconfig.go:128] "newest-cni-20210915192447-306161" context is missing from /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig - will repair!

	I0915 19:25:49.192496  658499 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:25:49.194847  658499 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0915 19:25:49.201275  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.201320  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.214159  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.414567  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.414650  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.428453  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.614750  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.614841  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.629035  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:49.815239  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.815314  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:49.829487  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.014705  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.014793  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.028845  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.215109  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.215187  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.229570  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.414965  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.415056  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.429618  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.614721  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.614813  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.629424  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:50.814656  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:50.814748  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:50.828758  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.015075  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.015151  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.029653  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.214966  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.215043  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.229599  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.414905  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.415010  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.429681  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.614998  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:51.615093  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.629477  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:51.814735  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:49.868213  616226 system_pods.go:86] 5 kube-system pods found

	I0915 19:25:49.868243  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868249  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Pending

	I0915 19:25:49.868253  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868261  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:25:49.868266  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:25:49.868283  616226 retry.go:31] will retry after 10.504197539s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0915 19:25:52.247783  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:54.748671  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:51.814879  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:51.830918  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.015132  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.015207  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.029416  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.214661  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.214764  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.228874  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.228893  658499 api_server.go:164] Checking apiserver status ...

	I0915 19:25:52.228968  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0915 19:25:52.241592  658499 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.241619  658499 kubeadm.go:575] needs reconfigure: apiserver error: timed out waiting for the condition

	I0915 19:25:52.241628  658499 kubeadm.go:1032] stopping kube-system containers ...

	I0915 19:25:52.241678  658499 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:25:52.326725  658499 docker.go:390] Stopping containers: [c179222cc03a ca89efd3bd43 6935f36879e1 2ac2f9892c63 a7566dbca80e 8990b45f27f2 9ef7104daa63 9a0297f799f6 000a541798ba 9923360704f0 e30bda4de2da f145142fe49d 416fe287f7ed 25ef2a9421bf abe4406c1e41 639e163b1a6c]

	I0915 19:25:52.326808  658499 ssh_runner.go:152] Run: docker stop c179222cc03a ca89efd3bd43 6935f36879e1 2ac2f9892c63 a7566dbca80e 8990b45f27f2 9ef7104daa63 9a0297f799f6 000a541798ba 9923360704f0 e30bda4de2da f145142fe49d 416fe287f7ed 25ef2a9421bf abe4406c1e41 639e163b1a6c

	I0915 19:25:52.362205  658499 ssh_runner.go:152] Run: sudo systemctl stop kubelet

	I0915 19:25:52.372252  658499 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0915 19:25:52.379153  658499 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5643 Sep 15 19:25 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 Sep 15 19:25 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2067 Sep 15 19:25 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Sep 15 19:25 /etc/kubernetes/scheduler.conf

	I0915 19:25:52.379207  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0915 19:25:52.385855  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0915 19:25:52.392314  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0915 19:25:52.398861  658499 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.398904  658499 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0915 19:25:52.405182  658499 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0915 19:25:52.411600  658499 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0915 19:25:52.412794  658499 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0915 19:25:52.419500  658499 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0915 19:25:52.426531  658499 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0915 19:25:52.426554  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:52.474669  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.644110  658499 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.169399501s)

	I0915 19:25:53.644151  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.762117  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.819163  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:25:53.898887  658499 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:25:53.898957  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:54.415251  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:54.915247  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.414769  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.915033  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:25:55.933394  658499 api_server.go:70] duration metric: took 2.034507407s to wait for apiserver process to appear ...

	I0915 19:25:55.933424  658499 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:25:55.933436  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:25:57.247739  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:59.248011  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:25:59.514511  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0915 19:25:59.514540  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0915 19:26:00.015222  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:00.021129  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0915 19:26:00.021167  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0915 19:26:00.514670  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:00.519244  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0915 19:26:00.519274  658499 api_server.go:101] status: https://192.168.49.2:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0915 19:26:01.014774  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:01.019564  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:

ok

	I0915 19:26:01.026375  658499 api_server.go:139] control plane version: v1.22.2-rc.0

	I0915 19:26:01.026397  658499 api_server.go:129] duration metric: took 5.092968284s to wait for apiserver health ...

	I0915 19:26:01.026409  658499 cni.go:93] Creating CNI manager for ""

	I0915 19:26:01.026415  658499 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:26:01.026423  658499 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:26:01.039605  658499 system_pods.go:59] 8 kube-system pods found

	I0915 19:26:01.039651  658499 system_pods.go:61] "coredns-78fcd69978-6vc5t" [4fc62da9-8a46-4e88-814b-0c76d25c9734] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0915 19:26:01.039660  658499 system_pods.go:61] "etcd-newest-cni-20210915192447-306161" [66265db3-03a5-460a-a582-040b20c0acb3] Running

	I0915 19:26:01.039677  658499 system_pods.go:61] "kube-apiserver-newest-cni-20210915192447-306161" [484dc944-d362-4284-aac4-741cd0a399a0] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0915 19:26:01.039688  658499 system_pods.go:61] "kube-controller-manager-newest-cni-20210915192447-306161" [21365108-04aa-41de-900b-1c01f35837f1] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0915 19:26:01.039695  658499 system_pods.go:61] "kube-proxy-xvwts" [e0adaced-8e5f-43d7-bdac-70078d101c80] Running

	I0915 19:26:01.039706  658499 system_pods.go:61] "kube-scheduler-newest-cni-20210915192447-306161" [b0ab4fca-c2bd-438d-b328-4bcbd11ac391] Running

	I0915 19:26:01.039714  658499 system_pods.go:61] "metrics-server-7c784ccb57-rj4cb" [f9a5652b-751d-4a11-8bf1-f1f8376c192b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:01.039730  658499 system_pods.go:61] "storage-provisioner" [f28d1a97-eb81-4e1d-a497-dc8774919d00] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0915 19:26:01.039740  658499 system_pods.go:74] duration metric: took 13.311777ms to wait for pod list to return data ...

	I0915 19:26:01.039752  658499 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:01.044529  658499 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:01.044624  658499 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:01.044647  658499 node_conditions.go:105] duration metric: took 4.889925ms to run NodePressure ...

	I0915 19:26:01.044670  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.2-rc.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0915 19:26:01.525775  658499 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0915 19:26:01.603382  658499 ops.go:34] apiserver oom_adj: -16

	I0915 19:26:01.603418  658499 kubeadm.go:604] restartCluster took 12.419028009s

	I0915 19:26:01.603430  658499 kubeadm.go:392] StartCluster complete in 12.458955049s

	I0915 19:26:01.603452  658499 settings.go:142] acquiring lock: {Name:mk44303efdfafafe2d54d1fbe38c690da58db0c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:26:01.603562  658499 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:26:01.604993  658499 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:26:01.610402  658499 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "newest-cni-20210915192447-306161" rescaled to 1

	I0915 19:26:01.610464  658499 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}

	I0915 19:26:01.610498  658499 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0915 19:26:01.612396  658499 out.go:177] * Verifying Kubernetes components...

	I0915 19:26:01.610593  658499 addons.go:404] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0915 19:26:01.612464  658499 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:26:01.612493  658499 addons.go:65] Setting storage-provisioner=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612519  658499 addons.go:153] Setting addon storage-provisioner=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612526  658499 addons.go:165] addon storage-provisioner should already be in state true

	I0915 19:26:01.612558  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.612570  658499 addons.go:65] Setting dashboard=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612592  658499 addons.go:153] Setting addon dashboard=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612601  658499 addons.go:165] addon dashboard should already be in state true

	I0915 19:26:01.612606  658499 addons.go:65] Setting default-storageclass=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612620  658499 addons.go:65] Setting metrics-server=true in profile "newest-cni-20210915192447-306161"

	I0915 19:26:01.612632  658499 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-20210915192447-306161"

	I0915 19:26:01.612637  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.612641  658499 addons.go:153] Setting addon metrics-server=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.612651  658499 addons.go:165] addon metrics-server should already be in state true

	I0915 19:26:01.612677  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.613056  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.613143  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.610707  658499 config.go:177] Loaded profile config "newest-cni-20210915192447-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0

	I0915 19:26:01.613228  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.613306  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.674162  658499 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0915 19:26:01.674222  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0915 19:26:01.674230  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0915 19:26:01.674285  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.676199  658499 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0915 19:26:01.677645  658499 out.go:177]   - Using image kubernetesui/dashboard:v2.1.0

	I0915 19:26:01.678904  658499 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0915 19:26:01.677695  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0915 19:26:01.678961  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0915 19:26:01.679012  658499 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:26:01.679027  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0915 19:26:01.679033  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.679069  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.705034  658499 addons.go:153] Setting addon default-storageclass=true in "newest-cni-20210915192447-306161"

	W0915 19:26:01.705061  658499 addons.go:165] addon default-storageclass should already be in state true

	I0915 19:26:01.705092  658499 host.go:66] Checking if "newest-cni-20210915192447-306161" exists ...

	I0915 19:26:01.705598  658499 cli_runner.go:115] Run: docker container inspect newest-cni-20210915192447-306161 --format={{.State.Status}}

	I0915 19:26:01.738733  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.739965  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.742106  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.767234  658499 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml

	I0915 19:26:01.767254  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0915 19:26:01.767300  658499 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915192447-306161

	I0915 19:26:01.815636  658499 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:26:01.817420  658499 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:26:01.815706  658499 start.go:709] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0915 19:26:01.815780  658499 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33262 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/newest-cni-20210915192447-306161/id_rsa Username:docker}

	I0915 19:26:01.848513  658499 api_server.go:70] duration metric: took 238.01851ms to wait for apiserver process to appear ...

	I0915 19:26:01.848543  658499 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:26:01.848556  658499 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 19:26:01.894803  658499 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:

ok

	I0915 19:26:01.895733  658499 api_server.go:139] control plane version: v1.22.2-rc.0

	I0915 19:26:01.895757  658499 api_server.go:129] duration metric: took 47.206532ms to wait for apiserver health ...

	I0915 19:26:01.895767  658499 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:26:01.901824  658499 system_pods.go:59] 8 kube-system pods found

	I0915 19:26:01.901862  658499 system_pods.go:61] "coredns-78fcd69978-6vc5t" [4fc62da9-8a46-4e88-814b-0c76d25c9734] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0915 19:26:01.901874  658499 system_pods.go:61] "etcd-newest-cni-20210915192447-306161" [66265db3-03a5-460a-a582-040b20c0acb3] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0915 19:26:01.901886  658499 system_pods.go:61] "kube-apiserver-newest-cni-20210915192447-306161" [484dc944-d362-4284-aac4-741cd0a399a0] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0915 19:26:01.901908  658499 system_pods.go:61] "kube-controller-manager-newest-cni-20210915192447-306161" [21365108-04aa-41de-900b-1c01f35837f1] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0915 19:26:01.901918  658499 system_pods.go:61] "kube-proxy-xvwts" [e0adaced-8e5f-43d7-bdac-70078d101c80] Running

	I0915 19:26:01.901933  658499 system_pods.go:61] "kube-scheduler-newest-cni-20210915192447-306161" [b0ab4fca-c2bd-438d-b328-4bcbd11ac391] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0915 19:26:01.901950  658499 system_pods.go:61] "metrics-server-7c784ccb57-rj4cb" [f9a5652b-751d-4a11-8bf1-f1f8376c192b] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:01.901969  658499 system_pods.go:61] "storage-provisioner" [f28d1a97-eb81-4e1d-a497-dc8774919d00] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0915 19:26:01.901980  658499 system_pods.go:74] duration metric: took 6.207128ms to wait for pod list to return data ...

	I0915 19:26:01.901998  658499 default_sa.go:34] waiting for default service account to be created ...

	I0915 19:26:01.906057  658499 default_sa.go:45] found service account: "default"

	I0915 19:26:01.906077  658499 default_sa.go:55] duration metric: took 4.069606ms for default service account to be created ...

	I0915 19:26:01.906088  658499 kubeadm.go:547] duration metric: took 295.598588ms to wait for : map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] ...

	I0915 19:26:01.906115  658499 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:01.908289  658499 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:01.908311  658499 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:01.908326  658499 node_conditions.go:105] duration metric: took 2.205441ms to run NodePressure ...

	I0915 19:26:01.908337  658499 start.go:231] waiting for startup goroutines ...

	I0915 19:26:01.909436  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:26:01.910167  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0915 19:26:01.910184  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0915 19:26:01.911211  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0915 19:26:01.911224  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0915 19:26:01.923700  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0915 19:26:01.923722  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0915 19:26:01.924713  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0915 19:26:01.924734  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)

	I0915 19:26:01.995665  658499 addons.go:337] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:26:01.995691  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)

	I0915 19:26:02.000056  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0915 19:26:02.000079  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0915 19:26:02.041624  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0915 19:26:02.096993  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0915 19:26:02.097019  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0915 19:26:02.097554  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:26:02.121824  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0915 19:26:02.121858  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0915 19:26:02.219076  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0915 19:26:02.219103  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0915 19:26:02.313273  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0915 19:26:02.313307  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0915 19:26:02.413094  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0915 19:26:02.413137  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0915 19:26:02.505773  658499 addons.go:337] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:26:02.505801  658499 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0915 19:26:02.520672  658499 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.2-rc.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:26:02.705901  658499 addons.go:375] Verifying addon metrics-server=true in "newest-cni-20210915192447-306161"

	I0915 19:26:02.907638  658499 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard

	I0915 19:26:02.907666  658499 addons.go:406] enableAddons completed in 1.297081165s

	I0915 19:26:02.956870  658499 start.go:462] kubectl: 1.20.5, cluster: 1.22.2-rc.0 (minor skew: 2)

	I0915 19:26:02.958889  658499 out.go:177]

	W0915 19:26:02.959057  658499 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.2-rc.0.

	I0915 19:26:02.960706  658499 out.go:177]   - Want kubectl v1.22.2-rc.0? Try 'minikube kubectl -- get pods -A'

	I0915 19:26:02.962354  658499 out.go:177] * Done! kubectl is now configured to use "newest-cni-20210915192447-306161" cluster and "default" namespace by default

	I0915 19:26:00.375999  616226 system_pods.go:86] 6 kube-system pods found

	I0915 19:26:00.376029  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376035  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376039  616226 system_pods.go:89] "kube-controller-manager-old-k8s-version-20210915191644-306161" [bdeb0721-165a-11ec-bbd7-02427fa71781] Pending

	I0915 19:26:00.376043  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376053  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:00.376057  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:00.376077  616226 retry.go:31] will retry after 12.194240946s: missing components: etcd, kube-controller-manager, kube-scheduler

	I0915 19:26:01.750821  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:04.247491  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:06.247946  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:08.748002  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:12.577146  616226 system_pods.go:86] 8 kube-system pods found

	I0915 19:26:12.577178  616226 system_pods.go:89] "coredns-fb8b8dccf-k7hjc" [a2e3c1d7-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577184  616226 system_pods.go:89] "etcd-old-k8s-version-20210915191644-306161" [c4798b55-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577189  616226 system_pods.go:89] "kube-apiserver-old-k8s-version-20210915191644-306161" [ba57c8ba-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577193  616226 system_pods.go:89] "kube-controller-manager-old-k8s-version-20210915191644-306161" [bdeb0721-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577197  616226 system_pods.go:89] "kube-proxy-48q9g" [a2b60d96-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577203  616226 system_pods.go:89] "kube-scheduler-old-k8s-version-20210915191644-306161" [c2afb80a-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577213  616226 system_pods.go:89] "metrics-server-8546d8b77b-nldb9" [a489e0be-165a-11ec-bbd7-02427fa71781] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:26:12.577220  616226 system_pods.go:89] "storage-provisioner" [a3f3ae2c-165a-11ec-bbd7-02427fa71781] Running

	I0915 19:26:12.577232  616226 system_pods.go:126] duration metric: took 59.17541112s to wait for k8s-apps to be running ...

	I0915 19:26:12.577266  616226 system_svc.go:44] waiting for kubelet service to be running ....

	I0915 19:26:12.577361  616226 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:26:12.587055  616226 system_svc.go:56] duration metric: took 9.780171ms WaitForService to wait for kubelet.

	I0915 19:26:12.587086  616226 kubeadm.go:547] duration metric: took 1m4.375805583s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0915 19:26:12.587109  616226 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:26:12.589395  616226 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:26:12.589414  616226 node_conditions.go:123] node cpu capacity is 8

	I0915 19:26:12.589427  616226 node_conditions.go:105] duration metric: took 2.311316ms to run NodePressure ...

	I0915 19:26:12.589438  616226 start.go:231] waiting for startup goroutines ...

	I0915 19:26:12.633073  616226 start.go:462] kubectl: 1.20.5, cluster: 1.14.0 (minor skew: 6)

	I0915 19:26:12.635246  616226 out.go:177]

	W0915 19:26:12.635424  616226 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.14.0.

	I0915 19:26:12.636879  616226 out.go:177]   - Want kubectl v1.14.0? Try 'minikube kubectl -- get pods -A'

	I0915 19:26:12.638502  616226 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-20210915191644-306161" cluster and "default" namespace by default

	I0915 19:26:10.748138  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:12.748288  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:15.247163  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:17.747317  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:20.247774  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:22.760200  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:25.247975  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:27.249625  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:29.747288  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:32.247204  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:34.248008  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:36.747942  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:39.247502  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:41.747739  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:44.247926  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:46.748057  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:48.748247  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:51.247885  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:53.747161  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:55.748183  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:26:58.249250  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:00.747639  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:02.747781  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:04.748187  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:07.247671  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:09.746250  630339 pod_ready.go:102] pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace has status "Ready":"False"

	I0915 19:27:10.242651  630339 pod_ready.go:81] duration metric: took 4m0.005329506s waiting for pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace to be "Ready" ...

	E0915 19:27:10.242680  630339 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-7c784ccb57-hvlzb" in "kube-system" namespace to be "Ready" (will not retry!)

	I0915 19:27:10.242705  630339 pod_ready.go:38] duration metric: took 4m6.433296781s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:27:10.242734  630339 kubeadm.go:604] restartCluster took 4m18.152274601s

	W0915 19:27:10.242869  630339 out.go:242] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	I0915 19:27:10.242903  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I0915 19:27:50.037209  630339 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (39.794285944s)

	I0915 19:27:50.037283  630339 ssh_runner.go:152] Run: sudo systemctl stop -f kubelet

	I0915 19:27:50.047448  630339 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0915 19:27:50.078023  630339 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0915 19:27:50.085196  630339 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver

	I0915 19:27:50.085266  630339 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0915 19:27:50.092152  630339 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0915 19:27:50.092199  630339 ssh_runner.go:243] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.22.1:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0915 19:27:50.611081  630339 out.go:204]   - Generating certificates and keys ...

	I0915 19:27:51.536655  630339 out.go:204]   - Booting up control plane ...

	I0915 19:28:00.115835  630339 out.go:204]   - Configuring RBAC rules ...

	I0915 19:28:00.529523  630339 cni.go:93] Creating CNI manager for ""

	I0915 19:28:00.529549  630339 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 19:28:00.529578  630339 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0915 19:28:00.529652  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.529696  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl label nodes minikube.k8s.io/version=v1.23.0 minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876 minikube.k8s.io/name=embed-certs-20210915191735-306161 minikube.k8s.io/updated_at=2021_09_15T19_28_00_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.803974  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:00.821740  630339 ops.go:34] apiserver oom_adj: -16

	I0915 19:28:01.435391  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:01.934873  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:02.434868  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:02.935381  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:03.435232  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:03.935356  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:04.435324  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:04.935377  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:05.435069  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:05.934949  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:06.435200  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:06.934921  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:07.435372  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:07.935041  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:08.435699  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:08.935259  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:09.435528  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:09.935682  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:10.435064  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:10.934937  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:11.435476  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:11.934809  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.434877  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.935451  630339 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.22.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0915 19:28:12.993725  630339 kubeadm.go:985] duration metric: took 12.464137165s to wait for elevateKubeSystemPrivileges.

	I0915 19:28:12.993758  630339 kubeadm.go:392] StartCluster complete in 5m20.941946433s

	I0915 19:28:12.993783  630339 settings.go:142] acquiring lock: {Name:mk44303efdfafafe2d54d1fbe38c690da58db0c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:28:12.993884  630339 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 19:28:12.994705  630339 lock.go:36] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig: {Name:mk317785f8d06eb065fac19e11d88cd5654f3cd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0915 19:28:13.509662  630339 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "embed-certs-20210915191735-306161" rescaled to 1

	I0915 19:28:13.509715  630339 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}

	I0915 19:28:13.511702  630339 out.go:177] * Verifying Kubernetes components...

	I0915 19:28:13.509779  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0915 19:28:13.509798  630339 addons.go:404] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0915 19:28:13.509982  630339 config.go:177] Loaded profile config "embed-certs-20210915191735-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 19:28:13.511808  630339 addons.go:65] Setting storage-provisioner=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511823  630339 addons.go:65] Setting default-storageclass=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511837  630339 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:13.511845  630339 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-20210915191735-306161"

	I0915 19:28:13.511845  630339 addons.go:65] Setting metrics-server=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.511867  630339 addons.go:153] Setting addon metrics-server=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.511879  630339 addons.go:165] addon metrics-server should already be in state true

	I0915 19:28:13.511829  630339 addons.go:153] Setting addon storage-provisioner=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.511914  630339 addons.go:165] addon storage-provisioner should already be in state true

	I0915 19:28:13.511922  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.511944  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.511808  630339 addons.go:65] Setting dashboard=true in profile "embed-certs-20210915191735-306161"

	I0915 19:28:13.512015  630339 addons.go:153] Setting addon dashboard=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.512035  630339 addons.go:165] addon dashboard should already be in state true

	I0915 19:28:13.512081  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.512200  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512412  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512453  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.512536  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.532167  630339 node_ready.go:35] waiting up to 6m0s for node "embed-certs-20210915191735-306161" to be "Ready" ...

	I0915 19:28:13.549865  630339 node_ready.go:49] node "embed-certs-20210915191735-306161" has status "Ready":"True"

	I0915 19:28:13.549892  630339 node_ready.go:38] duration metric: took 17.682852ms waiting for node "embed-certs-20210915191735-306161" to be "Ready" ...

	I0915 19:28:13.549905  630339 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:28:13.556092  630339 pod_ready.go:78] waiting up to 6m0s for pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:13.577195  630339 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0915 19:28:13.577327  630339 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:28:13.577341  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0915 19:28:13.577396  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.579872  630339 out.go:177]   - Using image kubernetesui/dashboard:v2.1.0

	I0915 19:28:13.581454  630339 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0915 19:28:13.581602  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0915 19:28:13.581620  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0915 19:28:13.581720  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.584563  630339 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0915 19:28:13.584623  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0915 19:28:13.584648  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0915 19:28:13.584699  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.596909  630339 addons.go:153] Setting addon default-storageclass=true in "embed-certs-20210915191735-306161"

	W0915 19:28:13.596971  630339 addons.go:165] addon default-storageclass should already be in state true

	I0915 19:28:13.597004  630339 host.go:66] Checking if "embed-certs-20210915191735-306161" exists ...

	I0915 19:28:13.597508  630339 cli_runner.go:115] Run: docker container inspect embed-certs-20210915191735-306161 --format={{.State.Status}}

	I0915 19:28:13.616213  630339 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.76.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.22.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0915 19:28:13.638070  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.640039  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.642485  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.662456  630339 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml

	I0915 19:28:13.662483  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0915 19:28:13.662531  630339 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20210915191735-306161

	I0915 19:28:13.714620  630339 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33252 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/embed-certs-20210915191735-306161/id_rsa Username:docker}

	I0915 19:28:13.812451  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0915 19:28:13.812477  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0915 19:28:13.821318  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0915 19:28:13.823897  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0915 19:28:13.823925  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0915 19:28:13.898690  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0915 19:28:13.898717  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)

	I0915 19:28:13.907259  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0915 19:28:13.907287  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0915 19:28:13.912105  630339 addons.go:337] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:28:13.912127  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)

	I0915 19:28:13.921012  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0915 19:28:13.921041  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0915 19:28:13.926989  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0915 19:28:13.936598  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0915 19:28:13.936631  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0915 19:28:14.015522  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0915 19:28:14.015551  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0915 19:28:14.018644  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0915 19:28:14.115517  630339 start.go:729] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS

	I0915 19:28:14.194584  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0915 19:28:14.194617  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0915 19:28:14.217096  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0915 19:28:14.217130  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0915 19:28:14.316665  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0915 19:28:14.316696  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0915 19:28:14.413346  630339 addons.go:337] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:28:14.413376  630339 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0915 19:28:14.514932  630339 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0915 19:28:15.394297  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.467264727s)

	I0915 19:28:15.394348  630339 addons.go:375] Verifying addon metrics-server=true in "embed-certs-20210915191735-306161"

	I0915 19:28:15.394404  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.375735791s)

	I0915 19:28:15.604399  630339 pod_ready.go:102] pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace has status "Ready":"False"

	I0915 19:28:16.394257  630339 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.879269229s)

	I0915 19:28:16.396287  630339 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard

	I0915 19:28:16.396326  630339 addons.go:406] enableAddons completed in 2.886542307s

	I0915 19:28:17.067421  630339 pod_ready.go:92] pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.067450  630339 pod_ready.go:81] duration metric: took 3.511327335s waiting for pod "coredns-78fcd69978-5pjmp" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.067464  630339 pod_ready.go:78] waiting up to 6m0s for pod "coredns-78fcd69978-px476" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.578427  630339 pod_ready.go:92] pod "coredns-78fcd69978-px476" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.578453  630339 pod_ready.go:81] duration metric: took 510.98247ms waiting for pod "coredns-78fcd69978-px476" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.578463  630339 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.582752  630339 pod_ready.go:92] pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.582768  630339 pod_ready.go:81] duration metric: took 4.299472ms waiting for pod "etcd-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.582777  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.595950  630339 pod_ready.go:92] pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.595967  630339 pod_ready.go:81] duration metric: took 13.185045ms waiting for pod "kube-apiserver-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.595975  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.599777  630339 pod_ready.go:92] pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:17.599796  630339 pod_ready.go:81] duration metric: took 3.813897ms waiting for pod "kube-controller-manager-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:17.599806  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jl2js" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.398806  630339 pod_ready.go:92] pod "kube-proxy-jl2js" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:18.398839  630339 pod_ready.go:81] duration metric: took 799.026276ms waiting for pod "kube-proxy-jl2js" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.398852  630339 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.697147  630339 pod_ready.go:92] pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace has status "Ready":"True"

	I0915 19:28:18.697171  630339 pod_ready.go:81] duration metric: took 298.310603ms waiting for pod "kube-scheduler-embed-certs-20210915191735-306161" in "kube-system" namespace to be "Ready" ...

	I0915 19:28:18.697183  630339 pod_ready.go:38] duration metric: took 5.147262663s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0915 19:28:18.697205  630339 api_server.go:50] waiting for apiserver process to appear ...

	I0915 19:28:18.697252  630339 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 19:28:18.726887  630339 api_server.go:70] duration metric: took 5.217142756s to wait for apiserver process to appear ...

	I0915 19:28:18.726919  630339 api_server.go:86] waiting for apiserver healthz status ...

	I0915 19:28:18.726930  630339 api_server.go:239] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...

	I0915 19:28:18.732297  630339 api_server.go:265] https://192.168.76.2:8443/healthz returned 200:

ok

	I0915 19:28:18.733382  630339 api_server.go:139] control plane version: v1.22.1

	I0915 19:28:18.733403  630339 api_server.go:129] duration metric: took 6.47846ms to wait for apiserver health ...

	I0915 19:28:18.733413  630339 system_pods.go:43] waiting for kube-system pods to appear ...

	I0915 19:28:18.899491  630339 system_pods.go:59] 9 kube-system pods found

	I0915 19:28:18.899577  630339 system_pods.go:61] "coredns-78fcd69978-5pjmp" [19356400-6282-4116-befe-300046323eaf] Running

	I0915 19:28:18.899605  630339 system_pods.go:61] "coredns-78fcd69978-px476" [6901b347-d524-4c8d-af90-51218a7c60e3] Running

	I0915 19:28:18.899613  630339 system_pods.go:61] "etcd-embed-certs-20210915191735-306161" [ab6ea6f9-3826-4d35-bd42-462c48430dbd] Running

	I0915 19:28:18.899622  630339 system_pods.go:61] "kube-apiserver-embed-certs-20210915191735-306161" [605eea37-ce31-445d-a1a2-331fb32a32a0] Running

	I0915 19:28:18.899631  630339 system_pods.go:61] "kube-controller-manager-embed-certs-20210915191735-306161" [f9fa8d2d-9be7-4eb4-a5e4-69a1f33e96f0] Running

	I0915 19:28:18.899642  630339 system_pods.go:61] "kube-proxy-jl2js" [a04e856f-4e7a-4873-806d-db2617c30f5e] Running

	I0915 19:28:18.899651  630339 system_pods.go:61] "kube-scheduler-embed-certs-20210915191735-306161" [0658f192-94f7-436d-9186-581eddea2329] Running

	I0915 19:28:18.899663  630339 system_pods.go:61] "metrics-server-7c784ccb57-6vvgw" [c9bddd13-c75f-4655-a463-5bfa136761f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:28:18.899674  630339 system_pods.go:61] "storage-provisioner" [1d578d39-1dc6-43a1-bd66-ab97567d32f4] Running

	I0915 19:28:18.899686  630339 system_pods.go:74] duration metric: took 166.266204ms to wait for pod list to return data ...

	I0915 19:28:18.899699  630339 default_sa.go:34] waiting for default service account to be created ...

	I0915 19:28:19.065102  630339 default_sa.go:45] found service account: "default"

	I0915 19:28:19.065130  630339 default_sa.go:55] duration metric: took 165.422256ms for default service account to be created ...

	I0915 19:28:19.065142  630339 system_pods.go:116] waiting for k8s-apps to be running ...

	I0915 19:28:19.303052  630339 system_pods.go:86] 9 kube-system pods found

	I0915 19:28:19.303102  630339 system_pods.go:89] "coredns-78fcd69978-5pjmp" [19356400-6282-4116-befe-300046323eaf] Running

	I0915 19:28:19.303112  630339 system_pods.go:89] "coredns-78fcd69978-px476" [6901b347-d524-4c8d-af90-51218a7c60e3] Running

	I0915 19:28:19.303120  630339 system_pods.go:89] "etcd-embed-certs-20210915191735-306161" [ab6ea6f9-3826-4d35-bd42-462c48430dbd] Running

	I0915 19:28:19.303129  630339 system_pods.go:89] "kube-apiserver-embed-certs-20210915191735-306161" [605eea37-ce31-445d-a1a2-331fb32a32a0] Running

	I0915 19:28:19.303140  630339 system_pods.go:89] "kube-controller-manager-embed-certs-20210915191735-306161" [f9fa8d2d-9be7-4eb4-a5e4-69a1f33e96f0] Running

	I0915 19:28:19.303147  630339 system_pods.go:89] "kube-proxy-jl2js" [a04e856f-4e7a-4873-806d-db2617c30f5e] Running

	I0915 19:28:19.303153  630339 system_pods.go:89] "kube-scheduler-embed-certs-20210915191735-306161" [0658f192-94f7-436d-9186-581eddea2329] Running

	I0915 19:28:19.303161  630339 system_pods.go:89] "metrics-server-7c784ccb57-6vvgw" [c9bddd13-c75f-4655-a463-5bfa136761f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0915 19:28:19.303169  630339 system_pods.go:89] "storage-provisioner" [1d578d39-1dc6-43a1-bd66-ab97567d32f4] Running

	I0915 19:28:19.303177  630339 system_pods.go:126] duration metric: took 238.029892ms to wait for k8s-apps to be running ...

	I0915 19:28:19.303189  630339 system_svc.go:44] waiting for kubelet service to be running ....

	I0915 19:28:19.303229  630339 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 19:28:19.315273  630339 system_svc.go:56] duration metric: took 12.072777ms WaitForService to wait for kubelet.

	I0915 19:28:19.315304  630339 kubeadm.go:547] duration metric: took 5.805567866s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0915 19:28:19.315335  630339 node_conditions.go:102] verifying NodePressure condition ...

	I0915 19:28:19.496010  630339 node_conditions.go:122] node storage ephemeral capacity is 309568300Ki

	I0915 19:28:19.496042  630339 node_conditions.go:123] node cpu capacity is 8

	I0915 19:28:19.496056  630339 node_conditions.go:105] duration metric: took 180.715079ms to run NodePressure ...

	I0915 19:28:19.496070  630339 start.go:231] waiting for startup goroutines ...

	I0915 19:28:19.546976  630339 start.go:462] kubectl: 1.20.5, cluster: 1.22.1 (minor skew: 2)

	I0915 19:28:19.551158  630339 out.go:177]

	W0915 19:28:19.551323  630339 out.go:242] ! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.1.

	I0915 19:28:19.553032  630339 out.go:177]   - Want kubectl v1.22.1? Try 'minikube kubectl -- get pods -A'

	I0915 19:28:19.554829  630339 out.go:177] * Done! kubectl is now configured to use "embed-certs-20210915191735-306161" cluster and "default" namespace by default

	* ==> Docker <==

	* -- Logs begin at Wed 2021-09-15 19:22:46 UTC, end at Wed 2021-09-15 19:28:36 UTC. --

	Sep 15 19:27:27 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:27.379480659Z" level=info msg="ignoring event" container=4c31d8e021d2202611f840c44cd13e658fd8a3512ea0cd5c72e60a464a8cdae4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:27 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:27.580497866Z" level=info msg="ignoring event" container=0bcfa338e2b36c8551b1622023e1a49e756a849f60b035b9ac59e36e7e6f19ba module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.685269003Z" level=info msg="Container b11aa5c2416fc148f8abd1b61250998ebdd83b86501a1349e8d0846acfcd6d65 failed to exit within 10 seconds of signal 15 - using the force"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.765940008Z" level=info msg="ignoring event" container=b11aa5c2416fc148f8abd1b61250998ebdd83b86501a1349e8d0846acfcd6d65 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:37 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:37.927652916Z" level=info msg="ignoring event" container=bd8cf098ba378d12ec990b16cade1d3c3c49aa2e0e4db6eff1f784d0bffc8b25 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.050101341Z" level=info msg="Container 9ad1922ac47a930e943058ee10ae7bd78a8b4c6e54289a0cbe58bdf3d75c0289 failed to exit within 10 seconds of signal 15 - using the force"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.139676793Z" level=info msg="ignoring event" container=9ad1922ac47a930e943058ee10ae7bd78a8b4c6e54289a0cbe58bdf3d75c0289 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.308200815Z" level=info msg="ignoring event" container=30eec8edd1cf762ffd11feb7d44d9ce48110af111f671840f2d8c938b88bb98a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.511562087Z" level=info msg="ignoring event" container=cffdd64547041cd6cbfd5ddae256f35c39a4dcbb73391ad69c6dc569745c3646 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.708067888Z" level=info msg="ignoring event" container=1379267275b562b1fb1bd304ebb18386d5df47a91059b097a1606fe4d15280ce module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:27:48 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:27:48.924261916Z" level=info msg="ignoring event" container=072a09912fc7d95c1fdc295f08d2d5aed9064d8a6aa422cfe60270d2f2317cbb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:15 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:15.396647319Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:28:15 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:15.398813317Z" level=warning msg="Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.831705608Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.831747780Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:16 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:16.895198551Z" level=error msg="Handler for POST /v1.41/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:17 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:17.570226113Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:17 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:17.736216910Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:21 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:21.944391345Z" level=info msg="ignoring event" container=4c08c98822f3a7096eb834043cf14326225b058e517c9919998fcfecc2271cbf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:22 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:22.072283155Z" level=info msg="ignoring event" container=7d0e1660b6830f0ceb46a5d8e182763c415317f769c08c599060519afaa8e55f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:22 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:22.408349267Z" level=info msg="ignoring event" container=efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:23.332421024Z" level=info msg="ignoring event" container=93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.627503342Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.627538813Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 dockerd[202]: time="2021-09-15T19:28:30.629266188Z" level=error msg="Handler for POST /v1.41/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID

	93c4ffacad816       a90209bb39e3d       13 seconds ago      Exited              dashboard-metrics-scraper   1                   d31a5597e2cb1

	926d1a5f90de2       9a07b5b4bfac0       19 seconds ago      Running             kubernetes-dashboard        0                   56a8b0483f25b

	72e461c907466       6e38f40d628db       20 seconds ago      Running             storage-provisioner         0                   353c427191072

	5309ef9aced95       8d147537fb7d1       21 seconds ago      Running             coredns                     0                   e6aac42275d8f

	203aaff34a12b       36c4ebbc9d979       23 seconds ago      Running             kube-proxy                  0                   8b31122a1686f

	c1475065f3e44       6e002eb89a881       43 seconds ago      Running             kube-controller-manager     2                   d9a422d58e610

	8c7ea90597c12       aca5ededae9c8       43 seconds ago      Running             kube-scheduler              2                   e690b5dbf4bca

	e539ab7aa4c48       f30469a2491a5       43 seconds ago      Running             kube-apiserver              2                   80a6803d9e664

	9f09acec9e72c       0048118155842       43 seconds ago      Running             etcd                        2                   182f2862b9a19

	* ==> coredns [5309ef9aced9] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	* ==> describe nodes <==

	* Name:               embed-certs-20210915191735-306161

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=embed-certs-20210915191735-306161

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=66748304c4ca78061b718f95ac626a53ac360876

	                    minikube.k8s.io/name=embed-certs-20210915191735-306161

	                    minikube.k8s.io/updated_at=2021_09_15T19_28_00_0700

	                    minikube.k8s.io/version=v1.23.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 15 Sep 2021 19:27:57 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  embed-certs-20210915191735-306161

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 15 Sep 2021 19:28:31 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:27:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 15 Sep 2021 19:28:31 +0000   Wed, 15 Sep 2021 19:28:10 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.76.2

	  Hostname:    embed-certs-20210915191735-306161

	Capacity:

	  cpu:                8

	  ephemeral-storage:  309568300Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32951360Ki

	  pods:               110

	Allocatable:

	  cpu:                8

	  ephemeral-storage:  309568300Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32951360Ki

	  pods:               110

	System Info:

	  Machine ID:                 4b5e5cdd53d44f5ab575bb522d42acca

	  System UUID:                c66d1e85-b803-40b4-ad10-2908790ed522

	  Boot ID:                    9576884f-b233-4069-9090-8df061dd5dc5

	  Kernel Version:             4.9.0-16-amd64

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.22.1

	  Kube-Proxy Version:         v1.22.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                         ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-78fcd69978-5pjmp                                     100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     23s

	  kube-system                 etcd-embed-certs-20210915191735-306161                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         35s

	  kube-system                 kube-apiserver-embed-certs-20210915191735-306161             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35s

	  kube-system                 kube-controller-manager-embed-certs-20210915191735-306161    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35s

	  kube-system                 kube-proxy-jl2js                                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         23s

	  kube-system                 kube-scheduler-embed-certs-20210915191735-306161             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35s

	  kube-system                 metrics-server-7c784ccb57-6vvgw                              100m (1%!)(MISSING)     0 (0%!)(MISSING)      300Mi (0%!)(MISSING)       0 (0%!)(MISSING)         21s

	  kube-system                 storage-provisioner                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         22s

	  kubernetes-dashboard        dashboard-metrics-scraper-8685c45546-nm652                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         21s

	  kubernetes-dashboard        kubernetes-dashboard-6fcdf4f6d-7b96n                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         21s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                850m (10%!)(MISSING)  0 (0%!)(MISSING)

	  memory             470Mi (1%!)(MISSING)  170Mi (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From     Message

	  ----    ------                   ----               ----     -------

	  Normal  NodeHasSufficientMemory  44s (x4 over 44s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    44s (x4 over 44s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     44s (x3 over 44s)  kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  44s                kubelet  Updated Node Allocatable limit across pods

	  Normal  Starting                 36s                kubelet  Starting kubelet.

	  Normal  NodeHasSufficientMemory  36s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    36s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     36s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             36s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  35s                kubelet  Updated Node Allocatable limit across pods

	  Normal  NodeReady                26s                kubelet  Node embed-certs-20210915191735-306161 status is now: NodeReady

	* ==> dmesg <==

	* [Sep15 19:18] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:19] cgroup: cgroup2: unknown option "nsdelegate"

	[ +15.778187] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:21] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:22] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:24] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:25] IPv4: martian source 10.85.0.2 from 10.85.0.2, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 7e 39 d7 48 28 bc 08 06        ......~9.H(...

	[  +0.000005] IPv4: martian source 10.85.0.2 from 10.85.0.2, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 7e 39 d7 48 28 bc 08 06        ......~9.H(...

	[  +0.006377] IPv4: martian source 10.85.0.3 from 10.85.0.3, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 1e 57 83 56 c2 5c 08 06        .......W.V.\..

	[  +0.000003] IPv4: martian source 10.85.0.3 from 10.85.0.3, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff 1e 57 83 56 c2 5c 08 06        .......W.V.\..

	[ +19.111963] cgroup: cgroup2: unknown option "nsdelegate"

	[Sep15 19:26] IPv4: martian source 10.85.0.4 from 10.85.0.4, on dev cni0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff c2 01 36 ba 27 5b 08 06        ........6.'[..

	[  +0.000005] IPv4: martian source 10.85.0.4 from 10.85.0.4, on dev eth0

	[  +0.000001] ll header: 00000000: ff ff ff ff ff ff c2 01 36 ba 27 5b 08 06        ........6.'[..

	[  +0.407875] IPv4: martian source 10.85.0.5 from 10.85.0.5, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 72 3d da 00 de a3 08 06        ......r=......

	[  +1.488405] IPv4: martian source 10.85.0.6 from 10.85.0.6, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 86 ff c8 b5 68 a2 08 06        ..........h...

	[  +0.004332] IPv4: martian source 10.85.0.7 from 10.85.0.7, on dev eth0

	[  +0.000002] ll header: 00000000: ff ff ff ff ff ff 92 e4 e8 a4 2e 43 08 06        ...........C..

	* ==> etcd [9f09acec9e72] <==

	* {"level":"info","ts":"2021-09-15T19:27:53.621Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 switched to configuration voters=(16896983918768216326)"}

	{"level":"info","ts":"2021-09-15T19:27:53.621Z","caller":"membership/cluster.go:393","msg":"added member","cluster-id":"6f20f2c4b2fb5f8a","local-member-id":"ea7e25599daad906","added-peer-id":"ea7e25599daad906","added-peer-peer-urls":["https://192.168.76.2:2380"]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:580","msg":"serving peer traffic","address":"192.168.76.2:2380"}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:552","msg":"cmux::serve","address":"192.168.76.2:2380"}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:276","msg":"now serving peer/client/metrics","local-member-id":"ea7e25599daad906","initial-advertise-peer-urls":["https://192.168.76.2:2380"],"listen-peer-urls":["https://192.168.76.2:2380"],"advertise-client-urls":["https://192.168.76.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.76.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2021-09-15T19:27:53.623Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 is starting a new election at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became pre-candidate at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 received MsgPreVoteResp from ea7e25599daad906 at term 1"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became candidate at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"ea7e25599daad906 became leader at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2"}

	{"level":"info","ts":"2021-09-15T19:27:54.115Z","caller":"etcdserver/server.go:2476","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"membership/cluster.go:531","msg":"set initial cluster version","cluster-id":"6f20f2c4b2fb5f8a","local-member-id":"ea7e25599daad906","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdserver/server.go:2500","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"ea7e25599daad906","local-member-attributes":"{Name:embed-certs-20210915191735-306161 ClientURLs:[https://192.168.76.2:2379]}","request-path":"/0/members/ea7e25599daad906/attributes","cluster-id":"6f20f2c4b2fb5f8a","publish-timeout":"7s"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-09-15T19:27:54.116Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-09-15T19:27:54.118Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2021-09-15T19:27:54.118Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.76.2:2379"}

	* ==> kernel <==

	*  19:28:36 up  5:08,  0 users,  load average: 1.17, 2.76, 3.27

	Linux embed-certs-20210915191735-306161 4.9.0-16-amd64 #1 SMP Debian 4.9.272-2 (2021-07-19) x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* ==> kube-apiserver [e539ab7aa4c4] <==

	* I0915 19:27:57.495669       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0915 19:27:57.497020       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller

	I0915 19:27:57.497820       1 cache.go:39] Caches are synced for autoregister controller

	I0915 19:27:57.500018       1 shared_informer.go:247] Caches are synced for node_authorizer

	I0915 19:27:57.506342       1 controller.go:611] quota admission added evaluator for: namespaces

	I0915 19:27:58.371056       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0915 19:27:58.371089       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0915 19:27:58.377016       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000

	I0915 19:27:58.384266       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000

	I0915 19:27:58.384288       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0915 19:27:58.775499       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0915 19:27:58.825091       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0915 19:27:58.922876       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]

	I0915 19:27:58.923994       1 controller.go:611] quota admission added evaluator for: endpoints

	I0915 19:27:58.928334       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0915 19:27:59.424038       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0915 19:28:00.259875       1 controller.go:611] quota admission added evaluator for: deployments.apps

	I0915 19:28:00.321204       1 controller.go:611] quota admission added evaluator for: daemonsets.apps

	I0915 19:28:00.510414       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0915 19:28:13.128751       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps

	I0915 19:28:13.179178       1 controller.go:611] quota admission added evaluator for: replicasets.apps

	W0915 19:28:17.834944       1 handler_proxy.go:104] no RequestInfo found in the context

	E0915 19:28:17.835033       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0915 19:28:17.835044       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	* ==> kube-controller-manager [c1475065f3e4] <==

	* I0915 19:28:15.007425       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-7c784ccb57-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"

	E0915 19:28:15.096593       1 replica_set.go:536] sync "kube-system/metrics-server-7c784ccb57" failed with pods "metrics-server-7c784ccb57-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found

	I0915 19:28:15.097815       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-7c784ccb57-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"

	I0915 19:28:15.109364       1 event.go:291] "Event occurred" object="kube-system/metrics-server-7c784ccb57" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-7c784ccb57-6vvgw"

	I0915 19:28:15.602075       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set dashboard-metrics-scraper-8685c45546 to 1"

	I0915 19:28:15.611771       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.616687       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.694827       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set kubernetes-dashboard-6fcdf4f6d to 1"

	E0915 19:28:15.703757       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.704433       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.710665       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.710963       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.710999       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.716268       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0915 19:28:15.794261       1 replica_set.go:536] sync "kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" failed with pods "dashboard-metrics-scraper-8685c45546-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0915 19:28:15.794420       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.794481       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-8685c45546-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.794507       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.800955       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.801040       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0915 19:28:15.810973       1 replica_set.go:536] sync "kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" failed with pods "kubernetes-dashboard-6fcdf4f6d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0915 19:28:15.811058       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-6fcdf4f6d-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0915 19:28:15.901529       1 event.go:291] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-8685c45546-nm652"

	I0915 19:28:15.902672       1 event.go:291] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-6fcdf4f6d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-6fcdf4f6d-7b96n"

	W0915 19:28:23.044049       1 endpointslice_controller.go:306] Error syncing endpoint slices for service "kube-system/kube-dns", retrying. Error: EndpointSlice informer cache is out of date

	* ==> kube-proxy [203aaff34a12] <==

	* I0915 19:28:15.099571       1 node.go:172] Successfully retrieved node IP: 192.168.76.2

	I0915 19:28:15.100122       1 server_others.go:140] Detected node IP 192.168.76.2

	W0915 19:28:15.100180       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I0915 19:28:15.213522       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0915 19:28:15.213562       1 server_others.go:212] Using iptables Proxier.

	I0915 19:28:15.213577       1 server_others.go:219] creating dualStackProxier for iptables.

	W0915 19:28:15.213592       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0915 19:28:15.213952       1 server.go:649] Version: v1.22.1

	I0915 19:28:15.214604       1 config.go:224] Starting endpoint slice config controller

	I0915 19:28:15.214622       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0915 19:28:15.214613       1 config.go:315] Starting service config controller

	I0915 19:28:15.214650       1 shared_informer.go:240] Waiting for caches to sync for service config

	E0915 19:28:15.221233       1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"embed-certs-20210915191735-306161.16a51583a92831cd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, EventTime:v1.MicroTime{Time:time.Time{wall:0xc048b033ccc9d5c6, ext:597927996, loc:(*time.Location)(0x2d81340)}}, Series:(*v1.EventSeries)(nil), ReportingController:"kube-proxy", ReportingInstance:"kube-proxy-embed-certs-20210915191735-306161", Action:"StartKubeProxy", Reason:"Starting", Regarding:v1.ObjectReference{Kind:"Node", Namespace:"",

Name:"embed-certs-20210915191735-306161", UID:"embed-certs-20210915191735-306161", APIVersion:"", ResourceVersion:"", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"", Type:"Normal", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedLastTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeprecatedCount:0}': 'Event "embed-certs-20210915191735-306161.16a51583a92831cd" is invalid: involvedObject.namespace: Invalid value: "": does not match event.namespace' (will not retry!)

	I0915 19:28:15.315668       1 shared_informer.go:247] Caches are synced for endpoint slice config

	I0915 19:28:15.326091       1 shared_informer.go:247] Caches are synced for service config

	* ==> kube-scheduler [8c7ea90597c1] <==

	* W0915 19:27:57.494947       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0915 19:27:57.517787       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I0915 19:27:57.517956       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0915 19:27:57.517984       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0915 19:27:57.518004       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E0915 19:27:57.598009       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0915 19:27:57.599178       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0915 19:27:57.601187       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:27:57.601189       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0915 19:27:57.601211       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0915 19:27:57.601349       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601363       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0915 19:27:57.601431       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0915 19:27:57.601533       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0915 19:27:57.601755       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0915 19:27:57.601797       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:57.601435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:27:57.601678       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0915 19:27:58.435738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0915 19:27:58.493388       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0915 19:27:58.502458       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0915 19:27:58.599251       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I0915 19:27:59.218079       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* ==> kubelet <==

	* -- Logs begin at Wed 2021-09-15 19:22:46 UTC, end at Wed 2021-09-15 19:28:36 UTC. --

	Sep 15 19:28:18 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:18.936164    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ImagePullBackOff: \"Back-off pulling image \\\"fake.domain/k8s.gcr.io/echoserver:1.4\\\"\"" pod="kube-system/metrics-server-7c784ccb57-6vvgw" podUID=c9bddd13-c75f-4655-a463-5bfa136761f3

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.332486    5969 reconciler.go:196] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mptnz\" (UniqueName: \"kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz\") pod \"6901b347-d524-4c8d-af90-51218a7c60e3\" (UID: \"6901b347-d524-4c8d-af90-51218a7c60e3\") "

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.332551    5969 reconciler.go:196] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume\") pod \"6901b347-d524-4c8d-af90-51218a7c60e3\" (UID: \"6901b347-d524-4c8d-af90-51218a7c60e3\") "

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: W0915 19:28:22.332826    5969 empty_dir.go:517] Warning: Failed to clear quota on /var/lib/kubelet/pods/6901b347-d524-4c8d-af90-51218a7c60e3/volumes/kubernetes.io~configmap/config-volume: clearQuota called, but quotas disabled

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.333010    5969 operation_generator.go:866] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume" (OuterVolumeSpecName: "config-volume") pod "6901b347-d524-4c8d-af90-51218a7c60e3" (UID: "6901b347-d524-4c8d-af90-51218a7c60e3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue ""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.369404    5969 operation_generator.go:866] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz" (OuterVolumeSpecName: "kube-api-access-mptnz") pod "6901b347-d524-4c8d-af90-51218a7c60e3" (UID: "6901b347-d524-4c8d-af90-51218a7c60e3"). InnerVolumeSpecName "kube-api-access-mptnz". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.432782    5969 reconciler.go:319] "Volume detached for volume \"kube-api-access-mptnz\" (UniqueName: \"kubernetes.io/projected/6901b347-d524-4c8d-af90-51218a7c60e3-kube-api-access-mptnz\") on node \"embed-certs-20210915191735-306161\" DevicePath \"\""

	Sep 15 19:28:22 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:22.432826    5969 reconciler.go:319] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6901b347-d524-4c8d-af90-51218a7c60e3-config-volume\") on node \"embed-certs-20210915191735-306161\" DevicePath \"\""

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.012132    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.015341    5969 scope.go:110] "RemoveContainer" containerID="efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4"

	Sep 15 19:28:23 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:23.020986    5969 scope.go:110] "RemoveContainer" containerID="4c08c98822f3a7096eb834043cf14326225b058e517c9919998fcfecc2271cbf"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.027950    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.032826    5969 scope.go:110] "RemoveContainer" containerID="efa986de08c05352d0b29b24c38fdb7c24cb5212a467dae4d0d3428f3e880ac4"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.033070    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:24.033378    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:24 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:24.612869    5969 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=6901b347-d524-4c8d-af90-51218a7c60e3 path="/var/lib/kubelet/pods/6901b347-d524-4c8d-af90-51218a7c60e3/volumes"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:25.041811    5969 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652 through plugin: invalid network status for"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:25.044805    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:25 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:25.045089    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:26 embed-certs-20210915191735-306161 kubelet[5969]: I0915 19:28:26.052319    5969 scope.go:110] "RemoveContainer" containerID="93c4ffacad816971d85191e44cae7722b64812768e9e67dcc10c75a8c9b470b0"

	Sep 15 19:28:26 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:26.052576    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dashboard-metrics-scraper\" with CrashLoopBackOff: \"back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8685c45546-nm652_kubernetes-dashboard(a8af7afe-3129-4e79-b29c-4d1152d53ecb)\"" pod="kubernetes-dashboard/dashboard-metrics-scraper-8685c45546-nm652" podUID=a8af7afe-3129-4e79-b29c-4d1152d53ecb

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629679    5969 remote_image.go:114] "PullImage from image service failed" err="rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" image="fake.domain/k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629725    5969 kuberuntime_image.go:51] "Failed to pull image" err="rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" image="fake.domain/k8s.gcr.io/echoserver:1.4"

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629881    5969 kuberuntime_manager.go:895] container &Container{Name:metrics-server,Image:fake.domain/k8s.gcr.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{314572800 0} {<nil>} 300Mi BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-xtfqw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handl

er{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez?exclude=readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz?exclude=livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]

VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-7c784ccb57-6vvgw_kube-system(c9bddd13-c75f-4655-a463-5bfa136761f3): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host

	Sep 15 19:28:30 embed-certs-20210915191735-306161 kubelet[5969]: E0915 19:28:30.629946    5969 pod_workers.go:747] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ErrImagePull: \"rpc error: code = Unknown desc = Error response from daemon: Get \\\"https://fake.domain/v2/\\\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host\"" pod="kube-system/metrics-server-7c784ccb57-6vvgw" podUID=c9bddd13-c75f-4655-a463-5bfa136761f3

	* ==> kubernetes-dashboard [926d1a5f90de] <==

	* 2021/09/15 19:28:17 Starting overwatch

	2021/09/15 19:28:17 Using namespace: kubernetes-dashboard

	2021/09/15 19:28:17 Using in-cluster config to connect to apiserver

	2021/09/15 19:28:17 Using secret token for csrf signing

	2021/09/15 19:28:17 Initializing csrf token from kubernetes-dashboard-csrf secret

	2021/09/15 19:28:17 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2021/09/15 19:28:17 Successful initial request to the apiserver, version: v1.22.1

	2021/09/15 19:28:17 Generating JWE encryption key

	2021/09/15 19:28:17 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2021/09/15 19:28:17 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2021/09/15 19:28:17 Initializing JWE encryption key from synchronized object

	2021/09/15 19:28:17 Creating in-cluster Sidecar client

	2021/09/15 19:28:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2021/09/15 19:28:17 Serving insecurely on HTTP port: 9090

	* ==> storage-provisioner [72e461c90746] <==

	* I0915 19:28:16.719493       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0915 19:28:16.728848       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0915 19:28:16.728896       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0915 19:28:16.736662       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0915 19:28:16.736810       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e!

	I0915 19:28:16.736811       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e70b1b5b-46a1-4b63-bdb1-82009463c3cf", APIVersion:"v1", ResourceVersion:"568", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e became leader

	I0915 19:28:16.893114       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_embed-certs-20210915191735-306161_0c36a7a7-a9c7-4d51-9e2a-3da0fe6f2a6e!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

E0915 19:28:36.857533  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/default-k8s-different-port-20210915191739-306161/client.crt: no such file or directory

helpers_test.go:262: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: metrics-server-7c784ccb57-6vvgw

helpers_test.go:273: ======> post-mortem[TestStartStop/group/embed-certs/serial/Pause]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw: exit status 1 (92.425339ms)

** stderr **

	Error from server (NotFound): pods "metrics-server-7c784ccb57-6vvgw" not found

** /stderr **

helpers_test.go:278: kubectl --context embed-certs-20210915191735-306161 describe pod metrics-server-7c784ccb57-6vvgw: exit status 1

--- FAIL: TestStartStop/group/embed-certs/serial/Pause (6.52s)

Test pass (262/284)

Order	passed test	Duration
3	TestDownloadOnly/v1.14.0/json-events	4.8
4	TestDownloadOnly/v1.14.0/preload-exists	0
8	TestDownloadOnly/v1.14.0/LogsDuration	0.07
10	TestDownloadOnly/v1.22.1/json-events	5.4
11	TestDownloadOnly/v1.22.1/preload-exists	0
15	TestDownloadOnly/v1.22.1/LogsDuration	0.07
17	TestDownloadOnly/v1.22.2-rc.0/json-events	5.37
18	TestDownloadOnly/v1.22.2-rc.0/preload-exists	0
22	TestDownloadOnly/v1.22.2-rc.0/LogsDuration	0.07
23	TestDownloadOnly/DeleteAll	0.4
24	TestDownloadOnly/DeleteAlwaysSucceeds	0.24
25	TestDownloadOnlyKic	9.31
26	TestOffline	70.3
28	TestAddons/Setup	133.52
30	TestAddons/parallel/Registry	17.37
31	TestAddons/parallel/Ingress	48.03
32	TestAddons/parallel/MetricsServer	5.89
33	TestAddons/parallel/HelmTiller	11.83
34	TestAddons/parallel/Olm	59.51
35	TestAddons/parallel/CSI	63.36
36	TestAddons/parallel/GCPAuth	50.88
37	TestAddons/StoppedEnableDisable	11.47
38	TestCertOptions	40.02
39	TestDockerFlags	37.22
40	TestForceSystemdFlag	50.15
41	TestForceSystemdEnv	34.34
42	TestKVMDriverInstallOrUpdate	2.67
46	TestErrorSpam/setup	21.37
47	TestErrorSpam/start	0.95
48	TestErrorSpam/status	1.17
49	TestErrorSpam/pause	1.31
50	TestErrorSpam/unpause	1.62
51	TestErrorSpam/stop	12.57
54	TestFunctional/serial/CopySyncFile	0
55	TestFunctional/serial/StartWithProxy	36.71
56	TestFunctional/serial/AuditLog	0
57	TestFunctional/serial/SoftStart	7.28
58	TestFunctional/serial/KubeContext	0.05
59	TestFunctional/serial/KubectlGetPods	0.17
62	TestFunctional/serial/CacheCmd/cache/add_remote	3.48
63	TestFunctional/serial/CacheCmd/cache/add_local	1.65
64	TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3	0.06
65	TestFunctional/serial/CacheCmd/cache/list	0.06
66	TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node	0.36
67	TestFunctional/serial/CacheCmd/cache/cache_reload	2.12
68	TestFunctional/serial/CacheCmd/cache/delete	0.11
69	TestFunctional/serial/MinikubeKubectlCmd	0.1
70	TestFunctional/serial/MinikubeKubectlCmdDirectly	0.1
71	TestFunctional/serial/ExtraConfig	29.1
72	TestFunctional/serial/ComponentHealth	0.07
73	TestFunctional/serial/LogsCmd	1.28
74	TestFunctional/serial/LogsFileCmd	1.28
76	TestFunctional/parallel/ConfigCmd	0.39
77	TestFunctional/parallel/DashboardCmd	2.97
78	TestFunctional/parallel/DryRun	0.6
79	TestFunctional/parallel/InternationalLanguage	0.26
80	TestFunctional/parallel/StatusCmd	1.36
83	TestFunctional/parallel/ServiceCmd	19.9
84	TestFunctional/parallel/AddonsCmd	0.17
85	TestFunctional/parallel/PersistentVolumeClaim	34.94
87	TestFunctional/parallel/SSHCmd	0.77
88	TestFunctional/parallel/CpCmd	0.78
89	TestFunctional/parallel/MySQL	23.63
90	TestFunctional/parallel/FileSync	0.39
91	TestFunctional/parallel/CertSync	2.22
95	TestFunctional/parallel/NodeLabels	0.09
96	TestFunctional/parallel/LoadImage	2.74
97	TestFunctional/parallel/SaveImage	4.29
98	TestFunctional/parallel/RemoveImage	2.86
99	TestFunctional/parallel/LoadImageFromFile	2.5
100	TestFunctional/parallel/SaveImageToFile	3.48
101	TestFunctional/parallel/BuildImage	4.11
102	TestFunctional/parallel/ListImages	0.28
103	TestFunctional/parallel/NonActiveRuntimeDisabled	0.4
105	TestFunctional/parallel/Version/short	0.06
106	TestFunctional/parallel/Version/components	0.71
108	TestFunctional/parallel/TunnelCmd/serial/StartTunnel	0
110	TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup	19.22
111	TestFunctional/parallel/DockerEnv/bash	1.58
112	TestFunctional/parallel/UpdateContextCmd/no_changes	0.2
113	TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster	0.18
114	TestFunctional/parallel/UpdateContextCmd/no_clusters	0.19
115	TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP	0.1
116	TestFunctional/parallel/TunnelCmd/serial/AccessDirect	0
120	TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel	0.11
121	TestFunctional/parallel/ProfileCmd/profile_not_create	0.69
122	TestFunctional/parallel/ProfileCmd/profile_list	0.68
123	TestFunctional/parallel/ProfileCmd/profile_json_output	0.46
124	TestFunctional/parallel/MountCmd/any-port	8.45
125	TestFunctional/parallel/MountCmd/specific-port	1.93
126	TestFunctional/delete_busybox_image	0.09
127	TestFunctional/delete_my-image_image	0.04
128	TestFunctional/delete_minikube_cached_images	0.04
132	TestJSONOutput/start/Command	41.72
133	TestJSONOutput/start/Audit	0.05
135	TestJSONOutput/start/parallel/DistinctCurrentSteps	0
136	TestJSONOutput/start/parallel/IncreasingCurrentSteps	0
138	TestJSONOutput/pause/Command	0.6
139	TestJSONOutput/pause/Audit	0
141	TestJSONOutput/pause/parallel/DistinctCurrentSteps	0
142	TestJSONOutput/pause/parallel/IncreasingCurrentSteps	0
144	TestJSONOutput/unpause/Command	0.58
145	TestJSONOutput/unpause/Audit	0
147	TestJSONOutput/unpause/parallel/DistinctCurrentSteps	0
148	TestJSONOutput/unpause/parallel/IncreasingCurrentSteps	0
150	TestJSONOutput/stop/Command	11.12
151	TestJSONOutput/stop/Audit	0
153	TestJSONOutput/stop/parallel/DistinctCurrentSteps	0
154	TestJSONOutput/stop/parallel/IncreasingCurrentSteps	0
155	TestErrorJSONOutput	0.34
157	TestKicCustomNetwork/create_custom_network	23.79
158	TestKicCustomNetwork/use_default_bridge_network	24.62
159	TestKicExistingNetwork	24.84
160	TestMainNoArgs	0.06
163	TestMultiNode/serial/FreshStart2Nodes	73.81
164	TestMultiNode/serial/DeployApp2Nodes	6.06
165	TestMultiNode/serial/PingHostFrom2Pods	0.87
166	TestMultiNode/serial/AddNode	26.26
167	TestMultiNode/serial/ProfileList	0.38
168	TestMultiNode/serial/CopyFile	2.86
169	TestMultiNode/serial/StopNode	2.65
170	TestMultiNode/serial/StartAfterStop	23.62
171	TestMultiNode/serial/RestartKeepsNodes	105.15
172	TestMultiNode/serial/DeleteNode	5.84
173	TestMultiNode/serial/StopMultiNode	22.1
174	TestMultiNode/serial/RestartMultiNode	57.73
175	TestMultiNode/serial/ValidateNameConflict	25.06
181	TestDebPackageInstall/install_amd64_debian_sid/minikube	0
182	TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver	11.86
184	TestDebPackageInstall/install_amd64_debian_latest/minikube	0
185	TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver	10.18
187	TestDebPackageInstall/install_amd64_debian_10/minikube	0
188	TestDebPackageInstall/install_amd64_debian_10/kvm2-driver	10.03
190	TestDebPackageInstall/install_amd64_debian_9/minikube	0
191	TestDebPackageInstall/install_amd64_debian_9/kvm2-driver	8.28
193	TestDebPackageInstall/install_amd64_ubuntu_latest/minikube	0
194	TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver	126.64
196	TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube	0
197	TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver	131.59
199	TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube	0
200	TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver	130.33
202	TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube	0
203	TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver	152.82
204	TestPreload	115.12
206	TestScheduledStopUnix	67.03
207	TestSkaffold	69.52
209	TestInsufficientStorage	9.53
210	TestRunningBinaryUpgrade	112.26
212	TestKubernetesUpgrade	107.91
213	TestMissingContainerUpgrade	117.01
218	TestPause/serial/Start	62.49
227	TestStoppedBinaryUpgrade/Upgrade	103.53
228	TestPause/serial/SecondStartNoReconfiguration	9.17
229	TestPause/serial/Pause	0.79
230	TestPause/serial/VerifyStatus	0.52
231	TestPause/serial/Unpause	2.33
233	TestStoppedBinaryUpgrade/MinikubeLogs	1.65
234	TestPause/serial/DeletePaused	3.02
235	TestPause/serial/VerifyDeletedResources	11.49
243	TestNetworkPlugins/group/auto/Start	95.35
244	TestNetworkPlugins/group/false/Start	51.51
245	TestNetworkPlugins/group/cilium/Start	112.28
246	TestNetworkPlugins/group/calico/Start	76.62
247	TestNetworkPlugins/group/false/KubeletFlags	0.42
248	TestNetworkPlugins/group/false/NetCatPod	11.19
249	TestNetworkPlugins/group/false/DNS	0.25
250	TestNetworkPlugins/group/false/Localhost	0.17
251	TestNetworkPlugins/group/false/HairPin	5.17
252	TestNetworkPlugins/group/custom-weave/Start	57.84
253	TestNetworkPlugins/group/auto/KubeletFlags	0.48
254	TestNetworkPlugins/group/auto/NetCatPod	9.43
255	TestNetworkPlugins/group/auto/DNS	0.18
256	TestNetworkPlugins/group/auto/Localhost	0.15
257	TestNetworkPlugins/group/auto/HairPin	5.16
258	TestNetworkPlugins/group/calico/ControllerPod	5.02
259	TestNetworkPlugins/group/calico/KubeletFlags	0.43
260	TestNetworkPlugins/group/bridge/Start	46.75
261	TestNetworkPlugins/group/calico/NetCatPod	14.46
262	TestNetworkPlugins/group/cilium/ControllerPod	5.02
263	TestNetworkPlugins/group/cilium/KubeletFlags	0.43
264	TestNetworkPlugins/group/calico/DNS	0.21
265	TestNetworkPlugins/group/cilium/NetCatPod	10.5
266	TestNetworkPlugins/group/calico/Localhost	0.19
267	TestNetworkPlugins/group/calico/HairPin	0.22
268	TestNetworkPlugins/group/kindnet/Start	76.56
269	TestNetworkPlugins/group/custom-weave/KubeletFlags	0.44
270	TestNetworkPlugins/group/custom-weave/NetCatPod	11.34
271	TestNetworkPlugins/group/cilium/DNS	0.22
272	TestNetworkPlugins/group/cilium/Localhost	0.18
273	TestNetworkPlugins/group/cilium/HairPin	0.18
274	TestNetworkPlugins/group/enable-default-cni/Start	58.81
275	TestNetworkPlugins/group/kubenet/Start	53.04
276	TestNetworkPlugins/group/bridge/KubeletFlags	0.46
277	TestNetworkPlugins/group/bridge/NetCatPod	10.26
278	TestNetworkPlugins/group/bridge/DNS	0.2
279	TestNetworkPlugins/group/bridge/Localhost	0.2
280	TestNetworkPlugins/group/bridge/HairPin	0.18
282	TestStartStop/group/old-k8s-version/serial/FirstStart	133.28
283	TestNetworkPlugins/group/enable-default-cni/KubeletFlags	0.4
284	TestNetworkPlugins/group/enable-default-cni/NetCatPod	9.29
285	TestNetworkPlugins/group/kindnet/ControllerPod	6.09
286	TestNetworkPlugins/group/kubenet/KubeletFlags	0.39
287	TestNetworkPlugins/group/kubenet/NetCatPod	12.21
288	TestNetworkPlugins/group/enable-default-cni/DNS	0.19
289	TestNetworkPlugins/group/enable-default-cni/Localhost	0.19
290	TestNetworkPlugins/group/enable-default-cni/HairPin	0.18
291	TestNetworkPlugins/group/kindnet/KubeletFlags	0.52
292	TestNetworkPlugins/group/kindnet/NetCatPod	9.27
294	TestStartStop/group/no-preload/serial/FirstStart	75.17
295	TestNetworkPlugins/group/kubenet/DNS	0.23
296	TestNetworkPlugins/group/kubenet/Localhost	0.18
297	TestNetworkPlugins/group/kubenet/HairPin	0.19
298	TestNetworkPlugins/group/kindnet/DNS	0.29
299	TestNetworkPlugins/group/kindnet/Localhost	0.24
300	TestNetworkPlugins/group/kindnet/HairPin	0.2
302	TestStartStop/group/embed-certs/serial/FirstStart	285.25
304	TestStartStop/group/default-k8s-different-port/serial/FirstStart	54.74
305	TestStartStop/group/default-k8s-different-port/serial/DeployApp	9.5
306	TestStartStop/group/no-preload/serial/DeployApp	9.36
307	TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive	0.75
308	TestStartStop/group/default-k8s-different-port/serial/Stop	11.12
309	TestStartStop/group/no-preload/serial/EnableAddonWhileActive	0.68
310	TestStartStop/group/no-preload/serial/Stop	11.13
311	TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop	0.2
312	TestStartStop/group/default-k8s-different-port/serial/SecondStart	332.37
313	TestStartStop/group/old-k8s-version/serial/DeployApp	9.38
314	TestStartStop/group/no-preload/serial/EnableAddonAfterStop	0.2
315	TestStartStop/group/no-preload/serial/SecondStart	332.79
316	TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive	0.76
317	TestStartStop/group/old-k8s-version/serial/Stop	11.23
318	TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop	0.23
319	TestStartStop/group/old-k8s-version/serial/SecondStart	413.24
320	TestStartStop/group/embed-certs/serial/DeployApp	12.32
321	TestStartStop/group/embed-certs/serial/EnableAddonWhileActive	0.8
322	TestStartStop/group/embed-certs/serial/Stop	11.21
323	TestStartStop/group/embed-certs/serial/EnableAddonAfterStop	0.2
324	TestStartStop/group/embed-certs/serial/SecondStart	334.5
325	TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop	7.01
326	TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop	5.09
327	TestStartStop/group/no-preload/serial/UserAppExistsAfterStop	9.02
328	TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages	0.45
329	TestStartStop/group/default-k8s-different-port/serial/Pause	3.55
330	TestStartStop/group/no-preload/serial/AddonExistsAfterStop	5.1
332	TestStartStop/group/newest-cni/serial/FirstStart	36.92
333	TestStartStop/group/no-preload/serial/VerifyKubernetesImages	0.44
334	TestStartStop/group/no-preload/serial/Pause	3.42
335	TestStartStop/group/newest-cni/serial/DeployApp	0
336	TestStartStop/group/newest-cni/serial/EnableAddonWhileActive	5.61
337	TestStartStop/group/newest-cni/serial/Stop	11.31
338	TestStartStop/group/newest-cni/serial/EnableAddonAfterStop	0.2
339	TestStartStop/group/newest-cni/serial/SecondStart	21.59
340	TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop	0
341	TestStartStop/group/newest-cni/serial/AddonExistsAfterStop	0
342	TestStartStop/group/newest-cni/serial/VerifyKubernetesImages	0.5
343	TestStartStop/group/newest-cni/serial/Pause	2.96
344	TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop	5.01
345	TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop	5.26
346	TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages	0.38
347	TestStartStop/group/old-k8s-version/serial/Pause	3.06
348	TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop	5.07
349	TestStartStop/group/embed-certs/serial/AddonExistsAfterStop	5.19
350	TestStartStop/group/embed-certs/serial/VerifyKubernetesImages	0.36

–

TestDownloadOnly/v1.14.0/json-events (4.8s)

=== RUN   TestDownloadOnly/v1.14.0/json-events

aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.14.0 --container-runtime=docker --driver=docker  --container-runtime=docker

aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.14.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (4.797188376s)

--- PASS: TestDownloadOnly/v1.14.0/json-events (4.80s)

–

TestDownloadOnly/v1.14.0/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.14.0/preload-exists

--- PASS: TestDownloadOnly/v1.14.0/preload-exists (0.00s)

–

TestDownloadOnly/v1.14.0/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.14.0/LogsDuration

aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-306161

aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-306161: exit status 85 (67.921154ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 18:41:25

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20210915184125-306161"

-- /stdout --

aaa_download_only_test.go:173: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.14.0/LogsDuration (0.07s)

–

TestDownloadOnly/v1.22.1/json-events (5.4s)

=== RUN   TestDownloadOnly/v1.22.1/json-events

aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.22.1 --container-runtime=docker --driver=docker  --container-runtime=docker

aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.22.1 --container-runtime=docker --driver=docker  --container-runtime=docker: (5.404259893s)

--- PASS: TestDownloadOnly/v1.22.1/json-events (5.40s)

–

TestDownloadOnly/v1.22.1/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.22.1/preload-exists

--- PASS: TestDownloadOnly/v1.22.1/preload-exists (0.00s)

–

TestDownloadOnly/v1.22.1/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.22.1/LogsDuration

aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-306161

aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-306161: exit status 85 (68.303112ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 18:41:30

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 18:41:30.362228  306313 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:41:30.362316  306313 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:41:30.362322  306313 out.go:311] Setting ErrFile to fd 2...

	I0915 18:41:30.362329  306313 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:41:30.362483  306313 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	W0915 18:41:30.362645  306313 root.go:291] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: no such file or directory

	I0915 18:41:30.362808  306313 out.go:305] Setting JSON to true

	I0915 18:41:30.398033  306313 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":15667,"bootTime":1631715623,"procs":143,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 18:41:30.398129  306313 start.go:121] virtualization: kvm guest

	I0915 18:41:30.400413  306313 notify.go:169] Checking for updates...

	I0915 18:41:30.403240  306313 config.go:177] Loaded profile config "download-only-20210915184125-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0

	W0915 18:41:30.403306  306313 start.go:659] api.Load failed for download-only-20210915184125-306161: filestore "download-only-20210915184125-306161": Docker machine "download-only-20210915184125-306161" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0915 18:41:30.403393  306313 driver.go:343] Setting default libvirt URI to qemu:///system

	W0915 18:41:30.403436  306313 start.go:659] api.Load failed for download-only-20210915184125-306161: filestore "download-only-20210915184125-306161": Docker machine "download-only-20210915184125-306161" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0915 18:41:30.456010  306313 docker.go:132] docker version: linux-19.03.15

	I0915 18:41:30.456121  306313 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:41:30.536957  306313 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:30.491911007 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:41:30.537052  306313 docker.go:237] overlay module found

	I0915 18:41:30.539084  306313 start.go:278] selected driver: docker

	I0915 18:41:30.539109  306313 start.go:751] validating driver "docker" against &{Name:download-only-20210915184125-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:download-only-20210915184125-306161 Namespace:default

APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:41:30.539642  306313 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:41:30.621069  306313 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:30.575537786 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:41:30.621654  306313 cni.go:93] Creating CNI manager for ""

	I0915 18:41:30.621677  306313 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 18:41:30.621688  306313 start_flags.go:278] config:

	{Name:download-only-20210915184125-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:download-only-20210915184125-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc

al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:41:30.623807  306313 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 18:41:30.625329  306313 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime docker

	I0915 18:41:30.625461  306313 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	I0915 18:41:30.684839  306313 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4

	I0915 18:41:30.684871  306313 cache.go:57] Caching tarball of preloaded images

	I0915 18:41:30.685131  306313 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime docker

	I0915 18:41:30.687201  306313 preload.go:237] getting checksum for preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:30.711463  306313 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 18:41:30.711491  306313 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 18:41:30.758140  306313 download.go:92] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4?checksum=md5:df04359146fc74639fed093942461742 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4

	I0915 18:41:33.915702  306313 preload.go:247] saving checksum for preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:33.915816  306313 preload.go:254] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.1-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:35.017713  306313 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.1 on docker

	I0915 18:41:35.017876  306313 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/download-only-20210915184125-306161/config.json ...

	I0915 18:41:35.018061  306313 preload.go:131] Checking if preload exists for k8s version v1.22.1 and runtime docker

	I0915 18:41:35.018317  306313 download.go:92] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.22.1/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.22.1/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/linux/v1.22.1/kubectl

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20210915184125-306161"

-- /stdout --

aaa_download_only_test.go:173: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.22.1/LogsDuration (0.07s)

–

TestDownloadOnly/v1.22.2-rc.0/json-events (5.37s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/json-events

aaa_download_only_test.go:70: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.22.2-rc.0 --container-runtime=docker --driver=docker  --container-runtime=docker

aaa_download_only_test.go:70: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-20210915184125-306161 --force --alsologtostderr --kubernetes-version=v1.22.2-rc.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (5.372608545s)

--- PASS: TestDownloadOnly/v1.22.2-rc.0/json-events (5.37s)

–

TestDownloadOnly/v1.22.2-rc.0/preload-exists (0s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/preload-exists

--- PASS: TestDownloadOnly/v1.22.2-rc.0/preload-exists (0.00s)

–

TestDownloadOnly/v1.22.2-rc.0/LogsDuration (0.07s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/LogsDuration

aaa_download_only_test.go:172: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-20210915184125-306161

aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-20210915184125-306161: exit status 85 (68.38026ms)

-- stdout --

	* ==> Audit <==

	* |---------|------|---------|------|---------|------------|----------|

	| Command | Args | Profile | User | Version | Start Time | End Time |

	|---------|------|---------|------|---------|------------|----------|

	|---------|------|---------|------|---------|------------|----------|

	* ==> Last Start <==

	* Log file created at: 2021/09/15 18:41:35

	Running on machine: debian-jenkins-agent-3

	Binary: Built with gc go1.17 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0915 18:41:35.838055  306454 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:41:35.838131  306454 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:41:35.838135  306454 out.go:311] Setting ErrFile to fd 2...

	I0915 18:41:35.838140  306454 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:41:35.838246  306454 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	W0915 18:41:35.838344  306454 root.go:291] Error reading config file at /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/config/config.json: no such file or directory

	I0915 18:41:35.838434  306454 out.go:305] Setting JSON to true

	I0915 18:41:35.873621  306454 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":15673,"bootTime":1631715623,"procs":143,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 18:41:35.873735  306454 start.go:121] virtualization: kvm guest

	I0915 18:41:35.876288  306454 notify.go:169] Checking for updates...

	I0915 18:41:35.878503  306454 config.go:177] Loaded profile config "download-only-20210915184125-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	W0915 18:41:35.878565  306454 start.go:659] api.Load failed for download-only-20210915184125-306161: filestore "download-only-20210915184125-306161": Docker machine "download-only-20210915184125-306161" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0915 18:41:35.878639  306454 driver.go:343] Setting default libvirt URI to qemu:///system

	W0915 18:41:35.878674  306454 start.go:659] api.Load failed for download-only-20210915184125-306161: filestore "download-only-20210915184125-306161": Docker machine "download-only-20210915184125-306161" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0915 18:41:35.929647  306454 docker.go:132] docker version: linux-19.03.15

	I0915 18:41:35.929760  306454 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:41:36.009304  306454 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:35.963444489 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:41:36.009404  306454 docker.go:237] overlay module found

	I0915 18:41:36.011453  306454 start.go:278] selected driver: docker

	I0915 18:41:36.011476  306454 start.go:751] validating driver "docker" against &{Name:download-only-20210915184125-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:download-only-20210915184125-306161 Namespace:default

APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:41:36.012121  306454 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:41:36.090783  306454 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:35 SystemTime:2021-09-15 18:41:36.046573672 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:41:36.091905  306454 cni.go:93] Creating CNI manager for ""

	I0915 18:41:36.091932  306454 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0915 18:41:36.091942  306454 start_flags.go:278] config:

	{Name:download-only-20210915184125-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:download-only-20210915184125-306161 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste

r.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:41:36.094068  306454 cache.go:118] Beginning downloading kic base image for docker with docker

	I0915 18:41:36.095701  306454 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 18:41:36.095803  306454 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon

	I0915 18:41:36.170497  306454 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4

	I0915 18:41:36.170524  306454 cache.go:57] Caching tarball of preloaded images

	I0915 18:41:36.170884  306454 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 18:41:36.173145  306454 preload.go:237] getting checksum for preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:36.182989  306454 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull

	I0915 18:41:36.183010  306454 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load

	I0915 18:41:36.234608  306454 download.go:92] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4?checksum=md5:55e401cc9516bdfbac04c93d8ed559d4 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4

	I0915 18:41:39.482585  306454 preload.go:247] saving checksum for preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:39.482685  306454 preload.go:254] verifying checksumm of /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 ...

	I0915 18:41:40.553763  306454 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.2-rc.0 on docker

	I0915 18:41:40.553919  306454 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/download-only-20210915184125-306161/config.json ...

	I0915 18:41:40.554132  306454 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker

	I0915 18:41:40.554387  306454 download.go:92] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.22.2-rc.0/bin/linux/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.22.2-rc.0/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/cache/linux/v1.22.2-rc.0/kubectl

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-20210915184125-306161"

-- /stdout --

aaa_download_only_test.go:173: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.22.2-rc.0/LogsDuration (0.07s)

–

TestDownloadOnly/DeleteAll (0.4s)

=== RUN   TestDownloadOnly/DeleteAll

aaa_download_only_test.go:190: (dbg) Run:  out/minikube-linux-amd64 delete --all

--- PASS: TestDownloadOnly/DeleteAll (0.40s)

–

TestDownloadOnly/DeleteAlwaysSucceeds (0.24s)

=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds

aaa_download_only_test.go:202: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-20210915184125-306161

--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.24s)

–

TestDownloadOnlyKic (9.31s)

=== RUN   TestDownloadOnlyKic

aaa_download_only_test.go:227: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-20210915184142-306161 --force --alsologtostderr --driver=docker  --container-runtime=docker

aaa_download_only_test.go:227: (dbg) Done: out/minikube-linux-amd64 start --download-only -p download-docker-20210915184142-306161 --force --alsologtostderr --driver=docker  --container-runtime=docker: (7.940706024s)

helpers_test.go:176: Cleaning up "download-docker-20210915184142-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-20210915184142-306161

--- PASS: TestDownloadOnlyKic (9.31s)

–

TestOffline (70.3s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

=== CONT  TestOffline

aab_offline_test.go:56: (dbg) Run:  out/minikube-linux-amd64 start -p offline-docker-20210915191040-306161 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker

=== CONT  TestOffline

aab_offline_test.go:56: (dbg) Done: out/minikube-linux-amd64 start -p offline-docker-20210915191040-306161 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m2.259100887s)

helpers_test.go:176: Cleaning up "offline-docker-20210915191040-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-docker-20210915191040-306161

=== CONT  TestOffline

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p offline-docker-20210915191040-306161: (8.036204997s)

--- PASS: TestOffline (70.30s)

–

TestAddons/Setup (133.52s)

=== RUN   TestAddons/Setup

addons_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p addons-20210915184151-306161 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --container-runtime=docker --addons=ingress --addons=helm-tiller

addons_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p addons-20210915184151-306161 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --container-runtime=docker --addons=ingress --addons=helm-tiller: (1m47.843913042s)

addons_test.go:89: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons enable gcp-auth

addons_test.go:89: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184151-306161 addons enable gcp-auth: (14.037938303s)

addons_test.go:99: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons enable gcp-auth --force

addons_test.go:99: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184151-306161 addons enable gcp-auth --force: (11.630554061s)

--- PASS: TestAddons/Setup (133.52s)

–

TestAddons/parallel/Registry (17.37s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:253: registry stabilized in 13.653352ms

addons_test.go:255: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

=== CONT  TestAddons/parallel/Registry

helpers_test.go:343: "registry-r9vgx" [387e12fe-813f-4bd7-9e71-27396c4ab250] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:255: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.042662654s

addons_test.go:258: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:343: "registry-proxy-9hgbd" [f7e68024-666b-44f1-92c5-3e30b7e98b7c] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:258: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.009138476s

addons_test.go:263: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete po -l run=registry-test --now

addons_test.go:268: (dbg) Run:  kubectl --context addons-20210915184151-306161 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

=== CONT  TestAddons/parallel/Registry

addons_test.go:268: (dbg) Done: kubectl --context addons-20210915184151-306161 run --rm registry-test --restart=Never --image=busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (6.427007452s)

addons_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 ip

2021/09/15 18:44:21 [DEBUG] GET http://192.168.49.2:5000

addons_test.go:311: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable registry --alsologtostderr -v=1

--- PASS: TestAddons/parallel/Registry (17.37s)

–

TestAddons/parallel/Ingress (48.03s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:170: (dbg) Run:  kubectl --context addons-20210915184151-306161 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:177: (dbg) Run:  kubectl --context addons-20210915184151-306161 replace --force -f testdata/nginx-ingv1.yaml

addons_test.go:190: (dbg) Run:  kubectl --context addons-20210915184151-306161 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:195: (dbg) TestAddons/parallel/Ingress: waiting 4m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:343: "nginx" [9c426809-f5ee-43c1-b7ea-23f9094660b0] Pending

helpers_test.go:343: "nginx" [9c426809-f5ee-43c1-b7ea-23f9094660b0] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

=== CONT  TestAddons/parallel/Ingress

helpers_test.go:343: "nginx" [9c426809-f5ee-43c1-b7ea-23f9094660b0] Running

=== CONT  TestAddons/parallel/Ingress

addons_test.go:195: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 18.007770354s

addons_test.go:215: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:234: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable ingress --alsologtostderr -v=1

=== CONT  TestAddons/parallel/Ingress

addons_test.go:234: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable ingress --alsologtostderr -v=1: (28.784358433s)

--- PASS: TestAddons/parallel/Ingress (48.03s)

–

TestAddons/parallel/MetricsServer (5.89s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:330: metrics-server stabilized in 8.382789ms

addons_test.go:332: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

helpers_test.go:343: "metrics-server-77c99ccb96-59nt4" [7d54046f-2a09-4e2d-82ed-b460cb8964ad] Running

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:332: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.00931102s

addons_test.go:338: (dbg) Run:  kubectl --context addons-20210915184151-306161 top pods -n kube-system

addons_test.go:355: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable metrics-server --alsologtostderr -v=1

--- PASS: TestAddons/parallel/MetricsServer (5.89s)

–

TestAddons/parallel/HelmTiller (11.83s)

=== RUN   TestAddons/parallel/HelmTiller

=== PAUSE TestAddons/parallel/HelmTiller

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:379: tiller-deploy stabilized in 2.385634ms

addons_test.go:381: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

helpers_test.go:343: "tiller-deploy-7d9fb5c894-ppwnc" [4fe5f4d8-97e4-49d2-bb97-d53406587fee] Running

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:381: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.01188543s

addons_test.go:396: (dbg) Run:  kubectl --context addons-20210915184151-306161 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:396: (dbg) Done: kubectl --context addons-20210915184151-306161 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (6.30481724s)

addons_test.go:413: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable helm-tiller --alsologtostderr -v=1

--- PASS: TestAddons/parallel/HelmTiller (11.83s)

–

TestAddons/parallel/Olm (59.51s)

=== RUN   TestAddons/parallel/Olm

=== PAUSE TestAddons/parallel/Olm

=== CONT  TestAddons/parallel/Olm

addons_test.go:425: (dbg) Run:  kubectl --context addons-20210915184151-306161 wait --for=condition=ready --namespace=olm pod --selector=app=catalog-operator --timeout=90s

=== CONT  TestAddons/parallel/Olm

addons_test.go:428: catalog-operator stabilized in 255.59262ms

addons_test.go:430: (dbg) Run:  kubectl --context addons-20210915184151-306161 wait --for=condition=ready --namespace=olm pod --selector=app=olm-operator --timeout=90s

=== CONT  TestAddons/parallel/Olm

addons_test.go:433: olm-operator stabilized in 368.27248ms

addons_test.go:435: (dbg) Run:  kubectl --context addons-20210915184151-306161 wait --for=condition=ready --namespace=olm pod --selector=app=packageserver --timeout=90s

=== CONT  TestAddons/parallel/Olm

addons_test.go:438: packageserver stabilized in 453.542902ms

addons_test.go:440: (dbg) Run:  kubectl --context addons-20210915184151-306161 wait --for=condition=ready --namespace=olm pod --selector=olm.catalogSource=operatorhubio-catalog --timeout=90s

addons_test.go:443: operatorhubio-catalog stabilized in 525.02205ms

addons_test.go:446: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/etcd.yaml

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

addons_test.go:458: kubectl --context addons-20210915184151-306161 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

addons_test.go:458: kubectl --context addons-20210915184151-306161 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

addons_test.go:458: kubectl --context addons-20210915184151-306161 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

addons_test.go:458: kubectl --context addons-20210915184151-306161 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

addons_test.go:458: kubectl --context addons-20210915184151-306161 get csv -n my-etcd: unexpected stderr: No resources found in my-etcd namespace.

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

=== CONT  TestAddons/parallel/Olm

addons_test.go:453: (dbg) Run:  kubectl --context addons-20210915184151-306161 get csv -n my-etcd

--- PASS: TestAddons/parallel/Olm (59.51s)

–

TestAddons/parallel/CSI (63.36s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:484: csi-hostpath-driver pods stabilized in 15.582945ms

addons_test.go:487: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/csi-hostpath-driver/pvc.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:492: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210915184151-306161 get pvc hpvc -o jsonpath={.status.phase} -n default

=== CONT  TestAddons/parallel/CSI

addons_test.go:497: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/csi-hostpath-driver/pv-pod.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:502: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:343: "task-pv-pod" [a002c854-95f0-452e-bd33-8692b8775ebf] Pending

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod" [a002c854-95f0-452e-bd33-8692b8775ebf] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod" [a002c854-95f0-452e-bd33-8692b8775ebf] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:502: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 18.006742098s

addons_test.go:507: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:512: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:418: (dbg) Run:  kubectl --context addons-20210915184151-306161 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:426: TestAddons/parallel/CSI: WARNING: volume snapshot get for "default" "new-snapshot-demo" returned:

helpers_test.go:418: (dbg) Run:  kubectl --context addons-20210915184151-306161 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:517: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete pod task-pv-pod

addons_test.go:517: (dbg) Done: kubectl --context addons-20210915184151-306161 delete pod task-pv-pod: (1.878347402s)

addons_test.go:523: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete pvc hpvc

addons_test.go:529: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

addons_test.go:534: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:393: (dbg) Run:  kubectl --context addons-20210915184151-306161 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:539: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:544: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:343: "task-pv-pod-restore" [011ec4bb-053a-4d78-a8da-8ec29ab87006] Pending

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod-restore" [011ec4bb-053a-4d78-a8da-8ec29ab87006] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:343: "task-pv-pod-restore" [011ec4bb-053a-4d78-a8da-8ec29ab87006] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:544: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 32.005704324s

addons_test.go:549: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete pod task-pv-pod-restore

addons_test.go:549: (dbg) Done: kubectl --context addons-20210915184151-306161 delete pod task-pv-pod-restore: (1.209478559s)

addons_test.go:553: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete pvc hpvc-restore

addons_test.go:557: (dbg) Run:  kubectl --context addons-20210915184151-306161 delete volumesnapshot new-snapshot-demo

addons_test.go:561: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable csi-hostpath-driver --alsologtostderr -v=1

=== CONT  TestAddons/parallel/CSI

addons_test.go:561: (dbg) Done: out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.961052557s)

addons_test.go:565: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable volumesnapshots --alsologtostderr -v=1

--- PASS: TestAddons/parallel/CSI (63.36s)

–

TestAddons/parallel/GCPAuth (50.88s)

=== RUN   TestAddons/parallel/GCPAuth

=== PAUSE TestAddons/parallel/GCPAuth

=== CONT  TestAddons/parallel/GCPAuth

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:576: (dbg) Run:  kubectl --context addons-20210915184151-306161 create -f testdata/busybox.yaml

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:582: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [718e22fa-6a77-4d4c-aed7-97b5438f3710] Pending

=== CONT  TestAddons/parallel/GCPAuth

helpers_test.go:343: "busybox" [718e22fa-6a77-4d4c-aed7-97b5438f3710] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

=== CONT  TestAddons/parallel/GCPAuth

helpers_test.go:343: "busybox" [718e22fa-6a77-4d4c-aed7-97b5438f3710] Running

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:582: (dbg) TestAddons/parallel/GCPAuth: integration-test=busybox healthy within 12.008560605s

addons_test.go:588: (dbg) Run:  kubectl --context addons-20210915184151-306161 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"

addons_test.go:625: (dbg) Run:  kubectl --context addons-20210915184151-306161 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:641: (dbg) Run:  kubectl --context addons-20210915184151-306161 apply -f testdata/private-image.yaml

addons_test.go:648: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image" in namespace "default" ...

helpers_test.go:343: "private-image-7ff9c8c74f-s6t6l" [f0fc8925-e1fb-4bb1-9191-79f7b9193694] Pending / Ready:ContainersNotReady (containers with unready status: [private-image]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image])

=== CONT  TestAddons/parallel/GCPAuth

helpers_test.go:343: "private-image-7ff9c8c74f-s6t6l" [f0fc8925-e1fb-4bb1-9191-79f7b9193694] Running

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:648: (dbg) TestAddons/parallel/GCPAuth: integration-test=private-image healthy within 16.081309238s

addons_test.go:654: (dbg) Run:  kubectl --context addons-20210915184151-306161 apply -f testdata/private-image-eu.yaml

addons_test.go:661: (dbg) TestAddons/parallel/GCPAuth: waiting 8m0s for pods matching "integration-test=private-image-eu" in namespace "default" ...

helpers_test.go:343: "private-image-eu-5956d58f9f-dzgmw" [9e629743-1c5e-4761-ba72-f28934f65199] Pending / Ready:ContainersNotReady (containers with unready status: [private-image-eu]) / ContainersReady:ContainersNotReady (containers with unready status: [private-image-eu])

=== CONT  TestAddons/parallel/GCPAuth

helpers_test.go:343: "private-image-eu-5956d58f9f-dzgmw" [9e629743-1c5e-4761-ba72-f28934f65199] Running

=== CONT  TestAddons/parallel/GCPAuth

addons_test.go:661: (dbg) TestAddons/parallel/GCPAuth: integration-test=private-image-eu healthy within 21.006192678s

addons_test.go:667: (dbg) Run:  out/minikube-linux-amd64 -p addons-20210915184151-306161 addons disable gcp-auth --alsologtostderr -v=1

--- PASS: TestAddons/parallel/GCPAuth (50.88s)

–

TestAddons/StoppedEnableDisable (11.47s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:140: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-20210915184151-306161

addons_test.go:140: (dbg) Done: out/minikube-linux-amd64 stop -p addons-20210915184151-306161: (11.270754963s)

addons_test.go:144: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-20210915184151-306161

addons_test.go:148: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-20210915184151-306161

--- PASS: TestAddons/StoppedEnableDisable (11.47s)

–

TestCertOptions (40.02s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:48: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-20210915191320-306161 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker

=== CONT  TestCertOptions

cert_options_test.go:48: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-20210915191320-306161 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (36.317630001s)

cert_options_test.go:59: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-20210915191320-306161 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:74: (dbg) Run:  kubectl --context cert-options-20210915191320-306161 config view

helpers_test.go:176: Cleaning up "cert-options-20210915191320-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-20210915191320-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-20210915191320-306161: (3.184919104s)

--- PASS: TestCertOptions (40.02s)

–

TestDockerFlags (37.22s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:46: (dbg) Run:  out/minikube-linux-amd64 start -p docker-flags-20210915191243-306161 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker

=== CONT  TestDockerFlags

docker_test.go:46: (dbg) Done: out/minikube-linux-amd64 start -p docker-flags-20210915191243-306161 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (33.066574068s)

docker_test.go:51: (dbg) Run:  out/minikube-linux-amd64 -p docker-flags-20210915191243-306161 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:62: (dbg) Run:  out/minikube-linux-amd64 -p docker-flags-20210915191243-306161 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

helpers_test.go:176: Cleaning up "docker-flags-20210915191243-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-flags-20210915191243-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-flags-20210915191243-306161: (3.117604494s)

--- PASS: TestDockerFlags (37.22s)

–

TestForceSystemdFlag (50.15s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:86: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-20210915191040-306161 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker

=== CONT  TestForceSystemdFlag

docker_test.go:86: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-20210915191040-306161 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (46.802520896s)

docker_test.go:103: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-20210915191040-306161 ssh "docker info --format {{.CgroupDriver}}"

helpers_test.go:176: Cleaning up "force-systemd-flag-20210915191040-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-20210915191040-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-20210915191040-306161: (2.878411407s)

--- PASS: TestForceSystemdFlag (50.15s)

–

TestForceSystemdEnv (34.34s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:137: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-20210915191133-306161 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker

=== CONT  TestForceSystemdEnv

docker_test.go:137: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-20210915191133-306161 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (31.056496538s)

docker_test.go:103: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-20210915191133-306161 ssh "docker info --format {{.CgroupDriver}}"

helpers_test.go:176: Cleaning up "force-systemd-env-20210915191133-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-20210915191133-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-20210915191133-306161: (2.830683437s)

--- PASS: TestForceSystemdEnv (34.34s)

–

TestKVMDriverInstallOrUpdate (2.67s)

=== RUN   TestKVMDriverInstallOrUpdate

=== PAUSE TestKVMDriverInstallOrUpdate

=== CONT  TestKVMDriverInstallOrUpdate

--- PASS: TestKVMDriverInstallOrUpdate (2.67s)

–

TestErrorSpam/setup (21.37s)

=== RUN   TestErrorSpam/setup

error_spam_test.go:79: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-20210915184542-306161 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20210915184542-306161 --driver=docker  --container-runtime=docker

error_spam_test.go:79: (dbg) Done: out/minikube-linux-amd64 start -p nospam-20210915184542-306161 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-20210915184542-306161 --driver=docker  --container-runtime=docker: (21.371459104s)

error_spam_test.go:89: acceptable stderr: "! Your cgroup does not allow setting memory."

error_spam_test.go:89: acceptable stderr: "! /usr/local/bin/kubectl is version 1.20.5, which may have incompatibilites with Kubernetes 1.22.1."

--- PASS: TestErrorSpam/setup (21.37s)

–

TestErrorSpam/start (0.95s)

=== RUN   TestErrorSpam/start

error_spam_test.go:214: Cleaning up 1 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 start --dry-run

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 start --dry-run

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 start --dry-run

--- PASS: TestErrorSpam/start (0.95s)

–

TestErrorSpam/status (1.17s)

=== RUN   TestErrorSpam/status

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 status

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 status

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 status

--- PASS: TestErrorSpam/status (1.17s)

–

TestErrorSpam/pause (1.31s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 pause

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 pause

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 pause

--- PASS: TestErrorSpam/pause (1.31s)

–

TestErrorSpam/unpause (1.62s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 unpause

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 unpause

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 unpause

--- PASS: TestErrorSpam/unpause (1.62s)

–

TestErrorSpam/stop (12.57s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:214: Cleaning up 0 logfile(s) ...

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 stop

error_spam_test.go:157: (dbg) Done: out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 stop: (12.290482287s)

error_spam_test.go:157: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 stop

error_spam_test.go:180: (dbg) Run:  out/minikube-linux-amd64 -p nospam-20210915184542-306161 --log_dir /tmp/nospam-20210915184542-306161 stop

--- PASS: TestErrorSpam/stop (12.57s)

–

TestFunctional/serial/CopySyncFile (0s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1726: local sync path: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/files/etc/test/nested/copy/306161/hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

–

TestFunctional/serial/StartWithProxy (36.71s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2102: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker

functional_test.go:2102: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184623-306161 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (36.709289598s)

--- PASS: TestFunctional/serial/StartWithProxy (36.71s)

–

TestFunctional/serial/AuditLog (0s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

–

TestFunctional/serial/SoftStart (7.28s)

=== RUN   TestFunctional/serial/SoftStart

functional_test.go:747: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --alsologtostderr -v=8

functional_test.go:747: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184623-306161 --alsologtostderr -v=8: (7.278457344s)

functional_test.go:751: soft start took 7.279235422s for "functional-20210915184623-306161" cluster.

--- PASS: TestFunctional/serial/SoftStart (7.28s)

–

TestFunctional/serial/KubeContext (0.05s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:767: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.05s)

–

TestFunctional/serial/KubectlGetPods (0.17s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:780: (dbg) Run:  kubectl --context functional-20210915184623-306161 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.17s)

–

TestFunctional/serial/CacheCmd/cache/add_remote (3.48s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add k8s.gcr.io/pause:3.1

functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add k8s.gcr.io/pause:3.3

functional_test.go:1102: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add k8s.gcr.io/pause:3.3: (1.503882876s)

functional_test.go:1102: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add k8s.gcr.io/pause:latest

functional_test.go:1102: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add k8s.gcr.io/pause:latest: (1.352032137s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.48s)

–

TestFunctional/serial/CacheCmd/cache/add_local (1.65s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_local

functional_test.go:1132: (dbg) Run:  docker build -t minikube-local-cache-test:functional-20210915184623-306161 /tmp/functional-20210915184623-306161196923768

functional_test.go:1144: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add minikube-local-cache-test:functional-20210915184623-306161

functional_test.go:1144: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 cache add minikube-local-cache-test:functional-20210915184623-306161: (1.354268178s)

functional_test.go:1149: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache delete minikube-local-cache-test:functional-20210915184623-306161

functional_test.go:1138: (dbg) Run:  docker rmi minikube-local-cache-test:functional-20210915184623-306161

--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.65s)

–

TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3

functional_test.go:1156: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.3

--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.06s)

–

TestFunctional/serial/CacheCmd/cache/list (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1163: (dbg) Run:  out/minikube-linux-amd64 cache list

--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

–

TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.36s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1176: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh sudo crictl images

--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.36s)

–

TestFunctional/serial/CacheCmd/cache/cache_reload (2.12s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1198: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh sudo docker rmi k8s.gcr.io/pause:latest

functional_test.go:1204: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

functional_test.go:1204: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (364.367423ms)

-- stdout --

	[31mFATA[0m[0000] no such image "k8s.gcr.io/pause:latest" present

-- /stdout --

** stderr **

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1209: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cache reload

functional_test.go:1209: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 cache reload: (1.007294196s)

functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.12s)

–

TestFunctional/serial/CacheCmd/cache/delete (0.11s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1223: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:3.1

functional_test.go:1223: (dbg) Run:  out/minikube-linux-amd64 cache delete k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

–

TestFunctional/serial/MinikubeKubectlCmd (0.1s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmd

functional_test.go:798: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 kubectl -- --context functional-20210915184623-306161 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.10s)

–

TestFunctional/serial/MinikubeKubectlCmdDirectly (0.1s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly

functional_test.go:821: (dbg) Run:  out/kubectl --context functional-20210915184623-306161 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.10s)

–

TestFunctional/serial/ExtraConfig (29.1s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:835: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

functional_test.go:835: (dbg) Done: out/minikube-linux-amd64 start -p functional-20210915184623-306161 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (29.10234851s)

functional_test.go:839: restart took 29.102510084s for "functional-20210915184623-306161" cluster.

--- PASS: TestFunctional/serial/ExtraConfig (29.10s)

–

TestFunctional/serial/ComponentHealth (0.07s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:886: (dbg) Run:  kubectl --context functional-20210915184623-306161 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:900: etcd phase: Running

functional_test.go:910: etcd status: Ready

functional_test.go:900: kube-apiserver phase: Running

functional_test.go:910: kube-apiserver status: Ready

functional_test.go:900: kube-controller-manager phase: Running

functional_test.go:910: kube-controller-manager status: Ready

functional_test.go:900: kube-scheduler phase: Running

functional_test.go:910: kube-scheduler status: Ready

--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

–

TestFunctional/serial/LogsCmd (1.28s)

=== RUN   TestFunctional/serial/LogsCmd

functional_test.go:1285: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 logs

functional_test.go:1285: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 logs: (1.277298929s)

--- PASS: TestFunctional/serial/LogsCmd (1.28s)

–

TestFunctional/serial/LogsFileCmd (1.28s)

=== RUN   TestFunctional/serial/LogsFileCmd

functional_test.go:1301: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 logs --file /tmp/functional-20210915184623-3061612777934194/logs.txt

functional_test.go:1301: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 logs --file /tmp/functional-20210915184623-3061612777934194/logs.txt: (1.279269429s)

--- PASS: TestFunctional/serial/LogsFileCmd (1.28s)

–

TestFunctional/parallel/ConfigCmd (0.39s)

=== RUN   TestFunctional/parallel/ConfigCmd

=== PAUSE TestFunctional/parallel/ConfigCmd

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config unset cpus

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config get cpus

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1249: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 config get cpus: exit status 14 (64.29246ms)

** stderr **

	Error: specified key could not be found in config

** /stderr **

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config set cpus 2

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config get cpus

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config unset cpus

functional_test.go:1249: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 config get cpus

functional_test.go:1249: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 config get cpus: exit status 14 (62.086937ms)

** stderr **

	Error: specified key could not be found in config

** /stderr **

--- PASS: TestFunctional/parallel/ConfigCmd (0.39s)

–

TestFunctional/parallel/DashboardCmd (2.97s)

=== RUN   TestFunctional/parallel/DashboardCmd

=== PAUSE TestFunctional/parallel/DashboardCmd

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:977: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20210915184623-306161 --alsologtostderr -v=1]

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:982: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-20210915184623-306161 --alsologtostderr -v=1] ...

=== CONT  TestFunctional/parallel/DashboardCmd

helpers_test.go:507: unable to kill pid 347610: os: process already finished

--- PASS: TestFunctional/parallel/DashboardCmd (2.97s)

–

TestFunctional/parallel/DryRun (0.6s)

=== RUN   TestFunctional/parallel/DryRun

=== PAUSE TestFunctional/parallel/DryRun

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:1039: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:1039: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20210915184623-306161 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (254.796489ms)

-- stdout --

	* [functional-20210915184623-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	  - MINIKUBE_LOCATION=12425

	* Using the docker driver based on existing profile

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

-- /stdout --

** stderr **

	I0915 18:48:14.586709  346774 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:48:14.586944  346774 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:48:14.586956  346774 out.go:311] Setting ErrFile to fd 2...

	I0915 18:48:14.586967  346774 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:48:14.587121  346774 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 18:48:14.587377  346774 out.go:305] Setting JSON to false

	I0915 18:48:14.625766  346774 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":16072,"bootTime":1631715623,"procs":242,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 18:48:14.625863  346774 start.go:121] virtualization: kvm guest

	I0915 18:48:14.628292  346774 out.go:177] * [functional-20210915184623-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	I0915 18:48:14.629828  346774 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 18:48:14.631209  346774 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 18:48:14.632716  346774 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 18:48:14.634043  346774 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 18:48:14.634443  346774 config.go:177] Loaded profile config "functional-20210915184623-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 18:48:14.634797  346774 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 18:48:14.685142  346774 docker.go:132] docker version: linux-19.03.15

	I0915 18:48:14.685237  346774 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:48:14.765705  346774 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2021-09-15 18:48:14.72060737 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddre

ss:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warning

s:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:48:14.765792  346774 docker.go:237] overlay module found

	I0915 18:48:14.767716  346774 out.go:177] * Using the docker driver based on existing profile

	I0915 18:48:14.767743  346774 start.go:278] selected driver: docker

	I0915 18:48:14.767750  346774 start.go:751] validating driver "docker" against &{Name:functional-20210915184623-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:functional-20210915184623-306161 Namespace:default APISer

verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-pr

ovisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:48:14.767886  346774 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 18:48:14.767926  346774 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 18:48:14.767946  346774 out.go:242] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I0915 18:48:14.769482  346774 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 18:48:14.772421  346774 out.go:177]

	W0915 18:48:14.772539  346774 out.go:242] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	I0915 18:48:14.774011  346774 out.go:177]

** /stderr **

functional_test.go:1054: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

--- PASS: TestFunctional/parallel/DryRun (0.60s)

–

TestFunctional/parallel/InternationalLanguage (0.26s)

=== RUN   TestFunctional/parallel/InternationalLanguage

=== PAUSE TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:1076: (dbg) Run:  out/minikube-linux-amd64 start -p functional-20210915184623-306161 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:1076: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-20210915184623-306161 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (258.167245ms)

-- stdout --

	* [functional-20210915184623-306161] minikube v1.23.0 sur Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	  - MINIKUBE_LOCATION=12425

	* Utilisation du pilote docker basé sur le profil existant

	  - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

-- /stdout --

** stderr **

	I0915 18:48:15.175922  347156 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:48:15.176046  347156 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:48:15.176057  347156 out.go:311] Setting ErrFile to fd 2...

	I0915 18:48:15.176063  347156 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:48:15.176226  347156 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 18:48:15.176463  347156 out.go:305] Setting JSON to false

	I0915 18:48:15.214442  347156 start.go:111] hostinfo: {"hostname":"debian-jenkins-agent-3","uptime":16072,"bootTime":1631715623,"procs":242,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"9.13","kernelVersion":"4.9.0-16-amd64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"c29e0b88-ef83-6765-d2fa-208fdce1af32"}

	I0915 18:48:15.214573  347156 start.go:121] virtualization: kvm guest

	I0915 18:48:15.217254  347156 out.go:177] * [functional-20210915184623-306161] minikube v1.23.0 sur Debian 9.13 (kvm/amd64)

	I0915 18:48:15.218867  347156 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	I0915 18:48:15.220221  347156 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0915 18:48:15.221580  347156 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	I0915 18:48:15.223029  347156 out.go:177]   - MINIKUBE_LOCATION=12425

	I0915 18:48:15.223497  347156 config.go:177] Loaded profile config "functional-20210915184623-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 18:48:15.223862  347156 driver.go:343] Setting default libvirt URI to qemu:///system

	I0915 18:48:15.274503  347156 docker.go:132] docker version: linux-19.03.15

	I0915 18:48:15.274632  347156 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:48:15.366939  347156 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:30 OomKillDisable:true NGoroutines:41 SystemTime:2021-09-15 18:48:15.317039925 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:48:15.367041  347156 docker.go:237] overlay module found

	I0915 18:48:15.368899  347156 out.go:177] * Utilisation du pilote docker basé sur le profil existant

	I0915 18:48:15.368958  347156 start.go:278] selected driver: docker

	I0915 18:48:15.368965  347156 start.go:751] validating driver "docker" against &{Name:functional-20210915184623-306161 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.1 ClusterName:functional-20210915184623-306161 Namespace:default APISer

verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.1 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-pr

ovisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0915 18:48:15.369068  347156 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	W0915 18:48:15.369109  347156 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0915 18:48:15.369131  347156 out.go:242] ! Votre groupe de contrôle ne permet pas de définir la mémoire.

	! Votre groupe de contrôle ne permet pas de définir la mémoire.

	I0915 18:48:15.370627  347156 out.go:177]   - Plus d'informations: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0915 18:48:15.372887  347156 out.go:177]

	W0915 18:48:15.373052  347156 out.go:242] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	I0915 18:48:15.374472  347156 out.go:177]

** /stderr **

--- PASS: TestFunctional/parallel/InternationalLanguage (0.26s)

–

TestFunctional/parallel/StatusCmd (1.36s)

=== RUN   TestFunctional/parallel/StatusCmd

=== PAUSE TestFunctional/parallel/StatusCmd

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:929: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 status

functional_test.go:935: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

functional_test.go:946: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 status -o json

--- PASS: TestFunctional/parallel/StatusCmd (1.36s)

–

TestFunctional/parallel/ServiceCmd (19.9s)

=== RUN   TestFunctional/parallel/ServiceCmd

=== PAUSE TestFunctional/parallel/ServiceCmd

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1477: (dbg) Run:  kubectl --context functional-20210915184623-306161 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8

functional_test.go:1483: (dbg) Run:  kubectl --context functional-20210915184623-306161 expose deployment hello-node --type=NodePort --port=8080

functional_test.go:1488: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...

helpers_test.go:343: "hello-node-6cbfcd7cbc-g5zgw" [30432e18-e988-4687-86d1-249fbddf9298] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

=== CONT  TestFunctional/parallel/ServiceCmd

helpers_test.go:343: "hello-node-6cbfcd7cbc-g5zgw" [30432e18-e988-4687-86d1-249fbddf9298] Running

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1488: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 17.006606808s

functional_test.go:1492: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 service list

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1492: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 service list: (1.40724409s)

functional_test.go:1505: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 service --namespace=default --https --url hello-node

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1514: found endpoint: https://192.168.49.2:30100

functional_test.go:1525: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 service hello-node --url --format={{.IP}}

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1534: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 service hello-node --url

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1540: found endpoint for hello-node: http://192.168.49.2:30100

functional_test.go:1551: Attempting to fetch http://192.168.49.2:30100 ...

functional_test.go:1570: http://192.168.49.2:30100: success! body:

Hostname: hello-node-6cbfcd7cbc-g5zgw

Pod Information:

	-no pod information available-

Server values:

	server_version=nginx: 1.13.3 - lua: 10008

Request Information:

	client_address=172.17.0.1

	method=GET

	real path=/

	query=

	request_version=1.1

	request_uri=http://192.168.49.2:8080/

Request Headers:

	accept-encoding=gzip

	host=192.168.49.2:30100

	user-agent=Go-http-client/1.1

Request Body:

	-no body in request-

--- PASS: TestFunctional/parallel/ServiceCmd (19.90s)

–

TestFunctional/parallel/AddonsCmd (0.17s)

=== RUN   TestFunctional/parallel/AddonsCmd

=== PAUSE TestFunctional/parallel/AddonsCmd

=== CONT  TestFunctional/parallel/AddonsCmd

functional_test.go:1585: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 addons list

functional_test.go:1596: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 addons list -o json

--- PASS: TestFunctional/parallel/AddonsCmd (0.17s)

–

TestFunctional/parallel/PersistentVolumeClaim (34.94s)

=== RUN   TestFunctional/parallel/PersistentVolumeClaim

=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...

helpers_test.go:343: "storage-provisioner" [54c08846-274e-4cf6-a995-03168864b6c8] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:45: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.009371767s

functional_test_pvc_test.go:50: (dbg) Run:  kubectl --context functional-20210915184623-306161 get storageclass -o=json

functional_test_pvc_test.go:70: (dbg) Run:  kubectl --context functional-20210915184623-306161 apply -f testdata/storage-provisioner/pvc.yaml

functional_test_pvc_test.go:77: (dbg) Run:  kubectl --context functional-20210915184623-306161 get pvc myclaim -o=json

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:77: (dbg) Run:  kubectl --context functional-20210915184623-306161 get pvc myclaim -o=json

functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20210915184623-306161 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:343: "sp-pod" [a8573eb3-342a-400e-8ad2-00b9564c9c0d] Pending

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [a8573eb3-342a-400e-8ad2-00b9564c9c0d] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [a8573eb3-342a-400e-8ad2-00b9564c9c0d] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 17.006693698s

functional_test_pvc_test.go:101: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec sp-pod -- touch /tmp/mount/foo

functional_test_pvc_test.go:107: (dbg) Run:  kubectl --context functional-20210915184623-306161 delete -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:126: (dbg) Run:  kubectl --context functional-20210915184623-306161 apply -f testdata/storage-provisioner/pod.yaml

2021/09/15 18:48:18 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:343: "sp-pod" [f8c019ea-aa3c-4249-aba2-e0b5e353537e] Pending

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [f8c019ea-aa3c-4249-aba2-e0b5e353537e] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

helpers_test.go:343: "sp-pod" [f8c019ea-aa3c-4249-aba2-e0b5e353537e] Running

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:131: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.007924558s

functional_test_pvc_test.go:115: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec sp-pod -- ls /tmp/mount

--- PASS: TestFunctional/parallel/PersistentVolumeClaim (34.94s)

–

TestFunctional/parallel/SSHCmd (0.77s)

=== RUN   TestFunctional/parallel/SSHCmd

=== PAUSE TestFunctional/parallel/SSHCmd

=== CONT  TestFunctional/parallel/SSHCmd

functional_test.go:1618: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "echo hello"

=== CONT  TestFunctional/parallel/SSHCmd

functional_test.go:1635: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "cat /etc/hostname"

--- PASS: TestFunctional/parallel/SSHCmd (0.77s)

–

TestFunctional/parallel/CpCmd (0.78s)

=== RUN   TestFunctional/parallel/CpCmd

=== PAUSE TestFunctional/parallel/CpCmd

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 cp testdata/cp-test.txt /home/docker/cp-test.txt

=== CONT  TestFunctional/parallel/CpCmd

helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /home/docker/cp-test.txt"

--- PASS: TestFunctional/parallel/CpCmd (0.78s)

–

TestFunctional/parallel/MySQL (23.63s)

=== RUN   TestFunctional/parallel/MySQL

=== PAUSE TestFunctional/parallel/MySQL

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1666: (dbg) Run:  kubectl --context functional-20210915184623-306161 replace --force -f testdata/mysql.yaml

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1671: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...

helpers_test.go:343: "mysql-9bbbc5bbb-bms89" [f2a7909a-e988-44f6-be85-3e7621a4dbd6] Pending

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:343: "mysql-9bbbc5bbb-bms89" [f2a7909a-e988-44f6-be85-3e7621a4dbd6] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:343: "mysql-9bbbc5bbb-bms89" [f2a7909a-e988-44f6-be85-3e7621a4dbd6] Running

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1671: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 18.019475322s

functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;"

functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;": exit status 1 (194.294192ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

	command terminated with exit code 1

** /stderr **

functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;"

functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;": exit status 1 (215.843435ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

	command terminated with exit code 1

** /stderr **

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;"

functional_test.go:1678: (dbg) Non-zero exit: kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;": exit status 1 (200.993401ms)

** stderr **

	mysql: [Warning] Using a password on the command line interface can be insecure.

	ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

	command terminated with exit code 1

** /stderr **

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1678: (dbg) Run:  kubectl --context functional-20210915184623-306161 exec mysql-9bbbc5bbb-bms89 -- mysql -ppassword -e "show databases;"

--- PASS: TestFunctional/parallel/MySQL (23.63s)

–

TestFunctional/parallel/FileSync (0.39s)

=== RUN   TestFunctional/parallel/FileSync

=== PAUSE TestFunctional/parallel/FileSync

=== CONT  TestFunctional/parallel/FileSync

functional_test.go:1798: Checking for existence of /etc/test/nested/copy/306161/hosts within VM

functional_test.go:1799: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /etc/test/nested/copy/306161/hosts"

=== CONT  TestFunctional/parallel/FileSync

functional_test.go:1804: file sync test content: Test file for checking file sync process

--- PASS: TestFunctional/parallel/FileSync (0.39s)

–

TestFunctional/parallel/CertSync (2.22s)

=== RUN   TestFunctional/parallel/CertSync

=== PAUSE TestFunctional/parallel/CertSync

=== CONT  TestFunctional/parallel/CertSync

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1839: Checking for existence of /etc/ssl/certs/306161.pem within VM

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /etc/ssl/certs/306161.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1839: Checking for existence of /usr/share/ca-certificates/306161.pem within VM

functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /usr/share/ca-certificates/306161.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1839: Checking for existence of /etc/ssl/certs/51391683.0 within VM

functional_test.go:1840: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /etc/ssl/certs/51391683.0"

functional_test.go:1866: Checking for existence of /etc/ssl/certs/3061612.pem within VM

functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /etc/ssl/certs/3061612.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1866: Checking for existence of /usr/share/ca-certificates/3061612.pem within VM

functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /usr/share/ca-certificates/3061612.pem"

=== CONT  TestFunctional/parallel/CertSync

functional_test.go:1866: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM

functional_test.go:1867: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"

--- PASS: TestFunctional/parallel/CertSync (2.22s)

–

TestFunctional/parallel/NodeLabels (0.09s)

=== RUN   TestFunctional/parallel/NodeLabels

=== PAUSE TestFunctional/parallel/NodeLabels

=== CONT  TestFunctional/parallel/NodeLabels

=== CONT  TestFunctional/parallel/NodeLabels

functional_test.go:218: (dbg) Run:  kubectl --context functional-20210915184623-306161 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"

--- PASS: TestFunctional/parallel/NodeLabels (0.09s)

–

TestFunctional/parallel/LoadImage (2.74s)

=== RUN   TestFunctional/parallel/LoadImage

=== PAUSE TestFunctional/parallel/LoadImage

=== CONT  TestFunctional/parallel/LoadImage

functional_test.go:241: (dbg) Run:  docker pull busybox:1.33

=== CONT  TestFunctional/parallel/LoadImage

functional_test.go:241: (dbg) Done: docker pull busybox:1.33: (1.247800945s)

functional_test.go:248: (dbg) Run:  docker tag busybox:1.33 docker.io/library/busybox:load-functional-20210915184623-306161

functional_test.go:254: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image load --daemon docker.io/library/busybox:load-functional-20210915184623-306161

=== CONT  TestFunctional/parallel/LoadImage

functional_test.go:254: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 image load --daemon docker.io/library/busybox:load-functional-20210915184623-306161: (1.010174549s)

functional_test.go:470: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184623-306161 -- docker image inspect docker.io/library/busybox:load-functional-20210915184623-306161

--- PASS: TestFunctional/parallel/LoadImage (2.74s)

–

TestFunctional/parallel/SaveImage (4.29s)

=== RUN   TestFunctional/parallel/SaveImage

=== PAUSE TestFunctional/parallel/SaveImage

=== CONT  TestFunctional/parallel/SaveImage

functional_test.go:379: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image pull docker.io/library/busybox:1.29

functional_test.go:379: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 image pull docker.io/library/busybox:1.29: (3.190916924s)

functional_test.go:388: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image tag docker.io/library/busybox:1.29 docker.io/library/busybox:save-functional-20210915184623-306161

functional_test.go:394: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image save --daemon docker.io/library/busybox:save-functional-20210915184623-306161

functional_test.go:400: (dbg) Run:  docker images busybox

--- PASS: TestFunctional/parallel/SaveImage (4.29s)

–

TestFunctional/parallel/RemoveImage (2.86s)

=== RUN   TestFunctional/parallel/RemoveImage

=== PAUSE TestFunctional/parallel/RemoveImage

=== CONT  TestFunctional/parallel/RemoveImage

=== CONT  TestFunctional/parallel/RemoveImage

functional_test.go:333: (dbg) Run:  docker pull busybox:1.32

=== CONT  TestFunctional/parallel/RemoveImage

functional_test.go:333: (dbg) Done: docker pull busybox:1.32: (1.478053236s)

functional_test.go:340: (dbg) Run:  docker tag busybox:1.32 docker.io/library/busybox:remove-functional-20210915184623-306161

=== CONT  TestFunctional/parallel/RemoveImage

functional_test.go:346: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image load docker.io/library/busybox:remove-functional-20210915184623-306161

=== CONT  TestFunctional/parallel/RemoveImage

functional_test.go:352: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image rm docker.io/library/busybox:remove-functional-20210915184623-306161

functional_test.go:484: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184623-306161 -- docker images

--- PASS: TestFunctional/parallel/RemoveImage (2.86s)

–

TestFunctional/parallel/LoadImageFromFile (2.5s)

=== RUN   TestFunctional/parallel/LoadImageFromFile

=== PAUSE TestFunctional/parallel/LoadImageFromFile

=== CONT  TestFunctional/parallel/LoadImageFromFile

functional_test.go:281: (dbg) Run:  docker pull busybox:1.31

=== CONT  TestFunctional/parallel/LoadImageFromFile

functional_test.go:281: (dbg) Done: docker pull busybox:1.31: (1.247228193s)

functional_test.go:288: (dbg) Run:  docker tag busybox:1.31 docker.io/library/busybox:load-from-file-functional-20210915184623-306161

functional_test.go:295: (dbg) Run:  docker save -o busybox-load.tar docker.io/library/busybox:load-from-file-functional-20210915184623-306161

functional_test.go:306: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image load /home/jenkins/workspace/Docker_Linux_integration/busybox-load.tar

=== CONT  TestFunctional/parallel/LoadImageFromFile

functional_test.go:484: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184623-306161 -- docker images

--- PASS: TestFunctional/parallel/LoadImageFromFile (2.50s)

–

TestFunctional/parallel/SaveImageToFile (3.48s)

=== RUN   TestFunctional/parallel/SaveImageToFile

=== PAUSE TestFunctional/parallel/SaveImageToFile

=== CONT  TestFunctional/parallel/SaveImageToFile

functional_test.go:421: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image pull docker.io/library/busybox:1.30

=== CONT  TestFunctional/parallel/SaveImageToFile

functional_test.go:421: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 image pull docker.io/library/busybox:1.30: (2.438714619s)

functional_test.go:429: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image tag docker.io/library/busybox:1.30 docker.io/library/busybox:save-to-file-functional-20210915184623-306161

functional_test.go:440: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image save docker.io/library/busybox:save-to-file-functional-20210915184623-306161 /home/jenkins/workspace/Docker_Linux_integration/busybox-save.tar

=== CONT  TestFunctional/parallel/SaveImageToFile

functional_test.go:446: (dbg) Run:  docker load -i /home/jenkins/workspace/Docker_Linux_integration/busybox-save.tar

functional_test.go:453: (dbg) Run:  docker images busybox

--- PASS: TestFunctional/parallel/SaveImageToFile (3.48s)

–

TestFunctional/parallel/BuildImage (4.11s)

=== RUN   TestFunctional/parallel/BuildImage

=== PAUSE TestFunctional/parallel/BuildImage

=== CONT  TestFunctional/parallel/BuildImage

functional_test.go:504: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image build -t localhost/my-image:functional-20210915184623-306161 testdata/build

=== CONT  TestFunctional/parallel/BuildImage

functional_test.go:504: (dbg) Done: out/minikube-linux-amd64 -p functional-20210915184623-306161 image build -t localhost/my-image:functional-20210915184623-306161 testdata/build: (3.664186433s)

functional_test.go:509: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20210915184623-306161 image build -t localhost/my-image:functional-20210915184623-306161 testdata/build:

Sending build context to Docker daemon  3.072kB

Step 1/3 : FROM busybox

latest: Pulling from library/busybox

24fb2886d6f6: Pulling fs layer

24fb2886d6f6: Download complete

24fb2886d6f6: Pull complete

Digest: sha256:52f73a0a43a16cf37cd0720c90887ce972fe60ee06a687ee71fb93a7ca601df7

Status: Downloaded newer image for busybox:latest

---> 16ea53ea7c65

Step 2/3 : RUN true

---> Running in ec55b948406d

Removing intermediate container ec55b948406d

---> 08f464e189fb

Step 3/3 : ADD content.txt /

---> 99749e55c083

Successfully built 99749e55c083

Successfully tagged localhost/my-image:functional-20210915184623-306161

functional_test.go:470: (dbg) Run:  out/minikube-linux-amd64 ssh -p functional-20210915184623-306161 -- docker image inspect localhost/my-image:functional-20210915184623-306161

--- PASS: TestFunctional/parallel/BuildImage (4.11s)

–

TestFunctional/parallel/ListImages (0.28s)

=== RUN   TestFunctional/parallel/ListImages

=== PAUSE TestFunctional/parallel/ListImages

=== CONT  TestFunctional/parallel/ListImages

functional_test.go:538: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 image ls

=== CONT  TestFunctional/parallel/ListImages

functional_test.go:543: (dbg) Stdout: out/minikube-linux-amd64 -p functional-20210915184623-306161 image ls:

k8s.gcr.io/pause:latest

k8s.gcr.io/pause:3.5

k8s.gcr.io/pause:3.3

k8s.gcr.io/pause:3.1

k8s.gcr.io/kube-scheduler:v1.22.1

k8s.gcr.io/kube-proxy:v1.22.1

k8s.gcr.io/kube-controller-manager:v1.22.1

k8s.gcr.io/kube-apiserver:v1.22.1

k8s.gcr.io/etcd:3.5.0-0

k8s.gcr.io/coredns/coredns:v1.8.4

gcr.io/k8s-minikube/storage-provisioner:v5

docker.io/library/minikube-local-cache-test:functional-20210915184623-306161

docker.io/kubernetesui/metrics-scraper:v1.0.4

docker.io/kubernetesui/dashboard:v2.1.0

--- PASS: TestFunctional/parallel/ListImages (0.28s)

–

TestFunctional/parallel/NonActiveRuntimeDisabled (0.4s)

=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled

=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

functional_test.go:1894: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo systemctl is-active crio"

=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled

functional_test.go:1894: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo systemctl is-active crio": exit status 1 (395.912289ms)

-- stdout --

	inactive

-- /stdout --

** stderr **

	ssh: Process exited with status 3

** /stderr **

--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.40s)

–

TestFunctional/parallel/Version/short (0.06s)

=== RUN   TestFunctional/parallel/Version/short

=== PAUSE TestFunctional/parallel/Version/short

=== CONT  TestFunctional/parallel/Version/short

functional_test.go:2123: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 version --short

--- PASS: TestFunctional/parallel/Version/short (0.06s)

–

TestFunctional/parallel/Version/components (0.71s)

=== RUN   TestFunctional/parallel/Version/components

=== PAUSE TestFunctional/parallel/Version/components

=== CONT  TestFunctional/parallel/Version/components

functional_test.go:2136: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 version -o=json --components

--- PASS: TestFunctional/parallel/Version/components (0.71s)

–

TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel

functional_test_tunnel_test.go:127: (dbg) daemon: [out/minikube-linux-amd64 -p functional-20210915184623-306161 tunnel --alsologtostderr]

--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (19.22s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:147: (dbg) Run:  kubectl --context functional-20210915184623-306161 apply -f testdata/testsvc.yaml

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...

helpers_test.go:343: "nginx-svc" [c64375de-1bdc-40b7-8a28-963a0ae7d3d1] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

helpers_test.go:343: "nginx-svc" [c64375de-1bdc-40b7-8a28-963a0ae7d3d1] Running

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup

functional_test_tunnel_test.go:151: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 19.00644099s

--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (19.22s)

–

TestFunctional/parallel/DockerEnv/bash (1.58s)

=== RUN   TestFunctional/parallel/DockerEnv/bash

functional_test.go:601: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-amd64 -p functional-20210915184623-306161 docker-env) && out/minikube-linux-amd64 status -p functional-20210915184623-306161"

=== CONT  TestFunctional/parallel/DockerEnv/bash

functional_test.go:622: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-amd64 -p functional-20210915184623-306161 docker-env) && docker images"

--- PASS: TestFunctional/parallel/DockerEnv/bash (1.58s)

–

TestFunctional/parallel/UpdateContextCmd/no_changes (0.2s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes

functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 update-context --alsologtostderr -v=2

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.20s)

–

TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.18s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 update-context --alsologtostderr -v=2

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.18s)

–

TestFunctional/parallel/UpdateContextCmd/no_clusters (0.19s)

=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters

=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters

functional_test.go:1985: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 update-context --alsologtostderr -v=2

--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.19s)

–

TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.1s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20210915184623-306161 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.10s)

–

TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect

functional_test_tunnel_test.go:234: tunnel at http://10.109.214.49 is working!

--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel

functional_test_tunnel_test.go:369: (dbg) stopping [out/minikube-linux-amd64 -p functional-20210915184623-306161 tunnel --alsologtostderr] ...

--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

–

TestFunctional/parallel/ProfileCmd/profile_not_create (0.69s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create

functional_test.go:1322: (dbg) Run:  out/minikube-linux-amd64 profile lis

functional_test.go:1326: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.69s)

–

TestFunctional/parallel/ProfileCmd/profile_list (0.68s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_list

functional_test.go:1360: (dbg) Run:  out/minikube-linux-amd64 profile list

functional_test.go:1365: Took "619.702477ms" to run "out/minikube-linux-amd64 profile list"

functional_test.go:1374: (dbg) Run:  out/minikube-linux-amd64 profile list -l

functional_test.go:1379: Took "60.149324ms" to run "out/minikube-linux-amd64 profile list -l"

--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.68s)

–

TestFunctional/parallel/ProfileCmd/profile_json_output (0.46s)

=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output

functional_test.go:1410: (dbg) Run:  out/minikube-linux-amd64 profile list -o json

functional_test.go:1415: Took "399.542283ms" to run "out/minikube-linux-amd64 profile list -o json"

functional_test.go:1423: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light

functional_test.go:1428: Took "54.984299ms" to run "out/minikube-linux-amd64 profile list -o json --light"

--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.46s)

–

TestFunctional/parallel/MountCmd/any-port (8.45s)

=== RUN   TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:77: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20210915184623-306161 /tmp/mounttest1157189694:/mount-9p --alsologtostderr -v=1]

functional_test_mount_test.go:111: wrote "test-1631731693437703537" to /tmp/mounttest1157189694/created-by-test

functional_test_mount_test.go:111: wrote "test-1631731693437703537" to /tmp/mounttest1157189694/created-by-test-removed-by-pod

functional_test_mount_test.go:111: wrote "test-1631731693437703537" to /tmp/mounttest1157189694/test-1631731693437703537

functional_test_mount_test.go:119: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:119: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (370.895457ms)

** stderr **

	ssh: Process exited with status 1

** /stderr **

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:119: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p"

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:133: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh -- ls -la /mount-9p

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:137: guest mount directory contents

total 2

-rw-r--r-- 1 docker docker 24 Sep 15 18:48 created-by-test

-rw-r--r-- 1 docker docker 24 Sep 15 18:48 created-by-test-removed-by-pod

-rw-r--r-- 1 docker docker 24 Sep 15 18:48 test-1631731693437703537

functional_test_mount_test.go:141: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh cat /mount-9p/test-1631731693437703537

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:152: (dbg) Run:  kubectl --context functional-20210915184623-306161 replace --force -f testdata/busybox-mount-test.yaml

functional_test_mount_test.go:157: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...

helpers_test.go:343: "busybox-mount" [7894e80c-8bfb-4be8-bbab-c2abe21e403e] Pending

helpers_test.go:343: "busybox-mount" [7894e80c-8bfb-4be8-bbab-c2abe21e403e] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])

=== CONT  TestFunctional/parallel/MountCmd/any-port

helpers_test.go:343: "busybox-mount" [7894e80c-8bfb-4be8-bbab-c2abe21e403e] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

functional_test_mount_test.go:157: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 5.008596788s

functional_test_mount_test.go:173: (dbg) Run:  kubectl --context functional-20210915184623-306161 logs busybox-mount

functional_test_mount_test.go:185: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh stat /mount-9p/created-by-test

functional_test_mount_test.go:185: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh stat /mount-9p/created-by-pod

=== CONT  TestFunctional/parallel/MountCmd/any-port

functional_test_mount_test.go:94: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo umount -f /mount-9p"

functional_test_mount_test.go:98: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184623-306161 /tmp/mounttest1157189694:/mount-9p --alsologtostderr -v=1] ...

--- PASS: TestFunctional/parallel/MountCmd/any-port (8.45s)

–

TestFunctional/parallel/MountCmd/specific-port (1.93s)

=== RUN   TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:226: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-20210915184623-306161 /tmp/mounttest1875220551:/mount-9p --alsologtostderr -v=1 --port 46464]

functional_test_mount_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p"

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:256: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (384.982937ms)

** stderr **

	ssh: Process exited with status 1

** /stderr **

functional_test_mount_test.go:256: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "findmnt -T /mount-9p | grep 9p"

=== CONT  TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:270: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh -- ls -la /mount-9p

functional_test_mount_test.go:274: guest mount directory contents

total 0

functional_test_mount_test.go:276: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184623-306161 /tmp/mounttest1875220551:/mount-9p --alsologtostderr -v=1 --port 46464] ...

functional_test_mount_test.go:277: reading mount text

functional_test_mount_test.go:291: done reading mount text

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo umount -f /mount-9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh "sudo umount -f /mount-9p": exit status 1 (341.748414ms)

-- stdout --

	umount: /mount-9p: not mounted.

-- /stdout --

** stderr **

	ssh: Process exited with status 32

** /stderr **

functional_test_mount_test.go:245: "out/minikube-linux-amd64 -p functional-20210915184623-306161 ssh \"sudo umount -f /mount-9p\"": exit status 1

functional_test_mount_test.go:247: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-20210915184623-306161 /tmp/mounttest1875220551:/mount-9p --alsologtostderr -v=1 --port 46464] ...

--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.93s)

–

TestFunctional/delete_busybox_image (0.09s)

=== RUN   TestFunctional/delete_busybox_image

functional_test.go:186: (dbg) Run:  docker rmi -f docker.io/library/busybox:load-functional-20210915184623-306161

functional_test.go:191: (dbg) Run:  docker rmi -f docker.io/library/busybox:remove-functional-20210915184623-306161

--- PASS: TestFunctional/delete_busybox_image (0.09s)

–

TestFunctional/delete_my-image_image (0.04s)

=== RUN   TestFunctional/delete_my-image_image

functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-20210915184623-306161

--- PASS: TestFunctional/delete_my-image_image (0.04s)

–

TestFunctional/delete_minikube_cached_images (0.04s)

=== RUN   TestFunctional/delete_minikube_cached_images

functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-20210915184623-306161

--- PASS: TestFunctional/delete_minikube_cached_images (0.04s)

–

TestJSONOutput/start/Command (41.72s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-20210915184830-306161 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker

E0915 18:49:04.942475  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:04.948182  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:04.958446  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:04.978733  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:05.019026  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:05.099388  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:05.259815  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:05.580769  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:06.221706  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:07.502669  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:49:10.062934  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-20210915184830-306161 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (41.720784929s)

--- PASS: TestJSONOutput/start/Command (41.72s)

–

TestJSONOutput/start/Audit (0.05s)

=== RUN   TestJSONOutput/start/Audit

--- PASS: TestJSONOutput/start/Audit (0.05s)

–

TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/pause/Command (0.6s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-20210915184830-306161 --output=json --user=testUser

--- PASS: TestJSONOutput/pause/Command (0.60s)

–

TestJSONOutput/pause/Audit (0s)

=== RUN   TestJSONOutput/pause/Audit

--- PASS: TestJSONOutput/pause/Audit (0.00s)

–

TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/unpause/Command (0.58s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-20210915184830-306161 --output=json --user=testUser

--- PASS: TestJSONOutput/unpause/Command (0.58s)

–

TestJSONOutput/unpause/Audit (0s)

=== RUN   TestJSONOutput/unpause/Audit

--- PASS: TestJSONOutput/unpause/Audit (0.00s)

–

TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

–

TestJSONOutput/stop/Command (11.12s)

=== RUN   TestJSONOutput/stop/Command

json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-20210915184830-306161 --output=json --user=testUser

E0915 18:49:15.183971  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-20210915184830-306161 --output=json --user=testUser: (11.122406552s)

--- PASS: TestJSONOutput/stop/Command (11.12s)

–

TestJSONOutput/stop/Audit (0s)

=== RUN   TestJSONOutput/stop/Audit

--- PASS: TestJSONOutput/stop/Audit (0.00s)

–

TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps

--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

–

TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps

--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

–

TestErrorJSONOutput (0.34s)

=== RUN   TestErrorJSONOutput

json_output_test.go:149: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-20210915184926-306161 --memory=2200 --output=json --wait=true --driver=fail

json_output_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-20210915184926-306161 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (92.505722ms)

-- stdout --

	{"specversion":"1.0","id":"22a6527c-8327-4f47-bd97-cd4750021d18","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-20210915184926-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"04f5425f-3dcd-4ba2-b13f-8c51a0fcaaa8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig"}}

	{"specversion":"1.0","id":"a44bf668-430e-4d4a-bc8f-afd1508f0aa4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}

	{"specversion":"1.0","id":"93798175-d987-466e-b48e-ab493fe8589e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube"}}

	{"specversion":"1.0","id":"dcb259d0-cf79-4ad7-beee-088e0580d144","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12425"}}

	{"specversion":"1.0","id":"b792ec71-4520-4de3-9233-b1e882dcc32e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

-- /stdout --

helpers_test.go:176: Cleaning up "json-output-error-20210915184926-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-20210915184926-306161

--- PASS: TestErrorJSONOutput (0.34s)

–

TestKicCustomNetwork/create_custom_network (23.79s)

=== RUN   TestKicCustomNetwork/create_custom_network

kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20210915184926-306161 --network=

E0915 18:49:45.905094  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20210915184926-306161 --network=: (21.230079786s)

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

helpers_test.go:176: Cleaning up "docker-network-20210915184926-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20210915184926-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20210915184926-306161: (2.514130905s)

--- PASS: TestKicCustomNetwork/create_custom_network (23.79s)

–

TestKicCustomNetwork/use_default_bridge_network (24.62s)

=== RUN   TestKicCustomNetwork/use_default_bridge_network

kic_custom_network_test.go:58: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-20210915184950-306161 --network=bridge

kic_custom_network_test.go:58: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-20210915184950-306161 --network=bridge: (22.234034031s)

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

helpers_test.go:176: Cleaning up "docker-network-20210915184950-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-20210915184950-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-20210915184950-306161: (2.347048429s)

--- PASS: TestKicCustomNetwork/use_default_bridge_network (24.62s)

–

TestKicExistingNetwork (24.84s)

=== RUN   TestKicExistingNetwork

kic_custom_network_test.go:102: (dbg) Run:  docker network ls --format {{.Name}}

kic_custom_network_test.go:94: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-20210915185015-306161 --network=existing-network

E0915 18:50:26.866234  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

kic_custom_network_test.go:94: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-20210915185015-306161 --network=existing-network: (22.053911291s)

helpers_test.go:176: Cleaning up "existing-network-20210915185015-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-20210915185015-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-20210915185015-306161: (2.51836952s)

--- PASS: TestKicExistingNetwork (24.84s)

–

TestMainNoArgs (0.06s)

=== RUN   TestMainNoArgs

main_test.go:68: (dbg) Run:  out/minikube-linux-amd64

--- PASS: TestMainNoArgs (0.06s)

–

TestMultiNode/serial/FreshStart2Nodes (73.81s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:82: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker

E0915 18:51:48.786668  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

multinode_test.go:82: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m13.209166628s)

multinode_test.go:88: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

--- PASS: TestMultiNode/serial/FreshStart2Nodes (73.81s)

–

TestMultiNode/serial/DeployApp2Nodes (6.06s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:463: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:468: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- rollout status deployment/busybox

multinode_test.go:468: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- rollout status deployment/busybox: (4.057756569s)

multinode_test.go:474: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:486: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:494: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-qqk5z -- nslookup kubernetes.io

multinode_test.go:494: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-w6s85 -- nslookup kubernetes.io

multinode_test.go:504: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-qqk5z -- nslookup kubernetes.default

multinode_test.go:504: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-w6s85 -- nslookup kubernetes.default

multinode_test.go:512: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-qqk5z -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:512: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-w6s85 -- nslookup kubernetes.default.svc.cluster.local

--- PASS: TestMultiNode/serial/DeployApp2Nodes (6.06s)

–

TestMultiNode/serial/PingHostFrom2Pods (0.87s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:522: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:530: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-qqk5z -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"

multinode_test.go:538: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-qqk5z -- sh -c "ping -c 1 192.168.49.1"

multinode_test.go:530: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-w6s85 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"

multinode_test.go:538: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-20210915185040-306161 -- exec busybox-84b6686758-w6s85 -- sh -c "ping -c 1 192.168.49.1"

--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.87s)

–

TestMultiNode/serial/AddNode (26.26s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:107: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20210915185040-306161 -v 3 --alsologtostderr

multinode_test.go:107: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-20210915185040-306161 -v 3 --alsologtostderr: (25.42406637s)

multinode_test.go:113: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

--- PASS: TestMultiNode/serial/AddNode (26.26s)

–

TestMultiNode/serial/ProfileList (0.38s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:129: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

--- PASS: TestMultiNode/serial/ProfileList (0.38s)

–

TestMultiNode/serial/CopyFile (2.86s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:170: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --output json --alsologtostderr

helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 cp testdata/cp-test.txt /home/docker/cp-test.txt

helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 ssh "sudo cat /home/docker/cp-test.txt"

helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 cp testdata/cp-test.txt multinode-20210915185040-306161-m02:/home/docker/cp-test.txt

helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 ssh -n multinode-20210915185040-306161-m02 "sudo cat /home/docker/cp-test.txt"

helpers_test.go:535: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 cp testdata/cp-test.txt multinode-20210915185040-306161-m03:/home/docker/cp-test.txt

helpers_test.go:549: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 ssh -n multinode-20210915185040-306161-m03 "sudo cat /home/docker/cp-test.txt"

--- PASS: TestMultiNode/serial/CopyFile (2.86s)

–

TestMultiNode/serial/StopNode (2.65s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:192: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 node stop m03

multinode_test.go:192: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185040-306161 node stop m03: (1.330565914s)

multinode_test.go:198: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status

multinode_test.go:198: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185040-306161 status: exit status 7 (659.948205ms)

-- stdout --

	multinode-20210915185040-306161

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	multinode-20210915185040-306161-m02

	type: Worker

	host: Running

	kubelet: Running

	multinode-20210915185040-306161-m03

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

multinode_test.go:205: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

multinode_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr: exit status 7 (657.162745ms)

-- stdout --

	multinode-20210915185040-306161

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	multinode-20210915185040-306161-m02

	type: Worker

	host: Running

	kubelet: Running

	multinode-20210915185040-306161-m03

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr **

	I0915 18:52:32.447422  382913 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:52:32.447515  382913 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:52:32.447520  382913 out.go:311] Setting ErrFile to fd 2...

	I0915 18:52:32.447524  382913 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:52:32.447624  382913 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 18:52:32.447791  382913 out.go:305] Setting JSON to false

	I0915 18:52:32.447814  382913 mustload.go:65] Loading cluster: multinode-20210915185040-306161

	I0915 18:52:32.448122  382913 config.go:177] Loaded profile config "multinode-20210915185040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 18:52:32.448136  382913 status.go:253] checking status of multinode-20210915185040-306161 ...

	I0915 18:52:32.448496  382913 cli_runner.go:115] Run: docker container inspect multinode-20210915185040-306161 --format={{.State.Status}}

	I0915 18:52:32.490851  382913 status.go:328] multinode-20210915185040-306161 host status = "Running" (err=<nil>)

	I0915 18:52:32.490888  382913 host.go:66] Checking if "multinode-20210915185040-306161" exists ...

	I0915 18:52:32.491136  382913 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20210915185040-306161

	I0915 18:52:32.534232  382913 host.go:66] Checking if "multinode-20210915185040-306161" exists ...

	I0915 18:52:32.534542  382913 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0915 18:52:32.534604  382913 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20210915185040-306161

	I0915 18:52:32.576971  382913 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33045 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/multinode-20210915185040-306161/id_rsa Username:docker}

	I0915 18:52:32.653785  382913 ssh_runner.go:152] Run: systemctl --version

	I0915 18:52:32.657373  382913 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 18:52:32.666248  382913 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0915 18:52:32.752654  382913 info.go:263] docker info: {ID:LQL6:IQEY:TAE3:NG47:ROZQ:WA5O:XM2B:XDCN:3VXZ:7JF3:4DHA:WN5N Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:199 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:39 OomKillDisable:true NGoroutines:45 SystemTime:2021-09-15 18:52:32.703393474 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.0-16-amd64 OperatingSystem:Debian GNU/Linux 9 (stretch) OSType:linux Architecture:x86_64 IndexServerAddr

ess:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33742192640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:debian-jenkins-agent-3 Labels:[] ExperimentalBuild:false ServerVersion:19.03.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:fec3683 Expected:fec3683} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnin

gs:[WARNING: No swap limit support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:<nil>}}

	I0915 18:52:32.754100  382913 kubeconfig.go:93] found "multinode-20210915185040-306161" server: "https://192.168.49.2:8443"

	I0915 18:52:32.754132  382913 api_server.go:164] Checking apiserver status ...

	I0915 18:52:32.754181  382913 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0915 18:52:32.774047  382913 ssh_runner.go:152] Run: sudo egrep ^[0-9]+:freezer: /proc/1864/cgroup

	I0915 18:52:32.781346  382913 api_server.go:180] apiserver freezer: "4:freezer:/docker/5476ca956b62ce7833c1feab2fa3a4812ec2db56236554c9719702c2acb0923b/kubepods/burstable/pod3944c61e48e9133600ea6b33d4a73d36/6f7002095fee89fce980f5e5d0e5cb906fa65d4d9e1eb2a518f052bf1d4e5f82"

	I0915 18:52:32.781401  382913 ssh_runner.go:152] Run: sudo cat /sys/fs/cgroup/freezer/docker/5476ca956b62ce7833c1feab2fa3a4812ec2db56236554c9719702c2acb0923b/kubepods/burstable/pod3944c61e48e9133600ea6b33d4a73d36/6f7002095fee89fce980f5e5d0e5cb906fa65d4d9e1eb2a518f052bf1d4e5f82/freezer.state

	I0915 18:52:32.787809  382913 api_server.go:202] freezer state: "THAWED"

	I0915 18:52:32.787836  382913 api_server.go:239] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0915 18:52:32.793003  382913 api_server.go:265] https://192.168.49.2:8443/healthz returned 200:

ok

	I0915 18:52:32.793025  382913 status.go:419] multinode-20210915185040-306161 apiserver status = Running (err=<nil>)

	I0915 18:52:32.793034  382913 status.go:255] multinode-20210915185040-306161 status: &{Name:multinode-20210915185040-306161 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0915 18:52:32.793061  382913 status.go:253] checking status of multinode-20210915185040-306161-m02 ...

	I0915 18:52:32.793284  382913 cli_runner.go:115] Run: docker container inspect multinode-20210915185040-306161-m02 --format={{.State.Status}}

	I0915 18:52:32.835485  382913 status.go:328] multinode-20210915185040-306161-m02 host status = "Running" (err=<nil>)

	I0915 18:52:32.835512  382913 host.go:66] Checking if "multinode-20210915185040-306161-m02" exists ...

	I0915 18:52:32.835823  382913 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-20210915185040-306161-m02

	I0915 18:52:32.877524  382913 host.go:66] Checking if "multinode-20210915185040-306161-m02" exists ...

	I0915 18:52:32.877855  382913 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0915 18:52:32.877896  382913 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-20210915185040-306161-m02

	I0915 18:52:32.919754  382913 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33050 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/machines/multinode-20210915185040-306161-m02/id_rsa Username:docker}

	I0915 18:52:32.998191  382913 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	I0915 18:52:33.007546  382913 status.go:255] multinode-20210915185040-306161-m02 status: &{Name:multinode-20210915185040-306161-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	I0915 18:52:33.007586  382913 status.go:253] checking status of multinode-20210915185040-306161-m03 ...

	I0915 18:52:33.007866  382913 cli_runner.go:115] Run: docker container inspect multinode-20210915185040-306161-m03 --format={{.State.Status}}

	I0915 18:52:33.050618  382913 status.go:328] multinode-20210915185040-306161-m03 host status = "Stopped" (err=<nil>)

	I0915 18:52:33.050650  382913 status.go:341] host is not running, skipping remaining checks

	I0915 18:52:33.050656  382913 status.go:255] multinode-20210915185040-306161-m03 status: &{Name:multinode-20210915185040-306161-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

--- PASS: TestMultiNode/serial/StopNode (2.65s)

–

TestMultiNode/serial/StartAfterStop (23.62s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:226: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 node start m03 --alsologtostderr

E0915 18:52:51.090956  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.096231  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.106473  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.126780  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.167128  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.247447  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.407875  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:51.728479  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:52.369385  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:52:53.650138  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

multinode_test.go:236: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185040-306161 node start m03 --alsologtostderr: (22.666322311s)

multinode_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status

E0915 18:52:56.210925  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

multinode_test.go:257: (dbg) Run:  kubectl get nodes

--- PASS: TestMultiNode/serial/StartAfterStop (23.62s)

–

TestMultiNode/serial/RestartKeepsNodes (105.15s)

=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:265: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185040-306161

multinode_test.go:272: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-20210915185040-306161

E0915 18:53:01.331522  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:53:11.571728  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

multinode_test.go:272: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-20210915185040-306161: (23.034892031s)

multinode_test.go:277: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true -v=8 --alsologtostderr

E0915 18:53:32.052902  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:54:04.943623  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 18:54:13.013492  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:54:32.627605  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

multinode_test.go:277: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true -v=8 --alsologtostderr: (1m22.0024361s)

multinode_test.go:282: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185040-306161

--- PASS: TestMultiNode/serial/RestartKeepsNodes (105.15s)

–

TestMultiNode/serial/DeleteNode (5.84s)

=== RUN   TestMultiNode/serial/DeleteNode

multinode_test.go:376: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 node delete m03

multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185040-306161 node delete m03: (4.891739671s)

multinode_test.go:382: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

multinode_test.go:396: (dbg) Run:  docker volume ls

multinode_test.go:406: (dbg) Run:  kubectl get nodes

multinode_test.go:414: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"

--- PASS: TestMultiNode/serial/DeleteNode (5.84s)

–

TestMultiNode/serial/StopMultiNode (22.1s)

=== RUN   TestMultiNode/serial/StopMultiNode

multinode_test.go:296: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 stop

multinode_test.go:296: (dbg) Done: out/minikube-linux-amd64 -p multinode-20210915185040-306161 stop: (21.829747284s)

multinode_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status

multinode_test.go:302: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185040-306161 status: exit status 7 (134.768327ms)

-- stdout --

	multinode-20210915185040-306161

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	multinode-20210915185040-306161-m02

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

multinode_test.go:309: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

multinode_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr: exit status 7 (133.894797ms)

-- stdout --

	multinode-20210915185040-306161

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	multinode-20210915185040-306161-m02

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr **

	I0915 18:55:09.667047  398862 out.go:298] Setting OutFile to fd 1 ...

	I0915 18:55:09.667246  398862 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:55:09.667256  398862 out.go:311] Setting ErrFile to fd 2...

	I0915 18:55:09.667259  398862 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0915 18:55:09.667363  398862 root.go:313] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/bin

	I0915 18:55:09.667506  398862 out.go:305] Setting JSON to false

	I0915 18:55:09.667529  398862 mustload.go:65] Loading cluster: multinode-20210915185040-306161

	I0915 18:55:09.667827  398862 config.go:177] Loaded profile config "multinode-20210915185040-306161": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1

	I0915 18:55:09.667841  398862 status.go:253] checking status of multinode-20210915185040-306161 ...

	I0915 18:55:09.668195  398862 cli_runner.go:115] Run: docker container inspect multinode-20210915185040-306161 --format={{.State.Status}}

	I0915 18:55:09.708496  398862 status.go:328] multinode-20210915185040-306161 host status = "Stopped" (err=<nil>)

	I0915 18:55:09.708524  398862 status.go:341] host is not running, skipping remaining checks

	I0915 18:55:09.708531  398862 status.go:255] multinode-20210915185040-306161 status: &{Name:multinode-20210915185040-306161 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0915 18:55:09.708602  398862 status.go:253] checking status of multinode-20210915185040-306161-m02 ...

	I0915 18:55:09.708876  398862 cli_runner.go:115] Run: docker container inspect multinode-20210915185040-306161-m02 --format={{.State.Status}}

	I0915 18:55:09.748723  398862 status.go:328] multinode-20210915185040-306161-m02 host status = "Stopped" (err=<nil>)

	I0915 18:55:09.748751  398862 status.go:341] host is not running, skipping remaining checks

	I0915 18:55:09.748772  398862 status.go:255] multinode-20210915185040-306161-m02 status: &{Name:multinode-20210915185040-306161-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

--- PASS: TestMultiNode/serial/StopMultiNode (22.10s)

–

TestMultiNode/serial/RestartMultiNode (57.73s)

=== RUN   TestMultiNode/serial/RestartMultiNode

multinode_test.go:326: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:336: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker

E0915 18:55:34.934262  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

multinode_test.go:336: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185040-306161 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (56.953459715s)

multinode_test.go:342: (dbg) Run:  out/minikube-linux-amd64 -p multinode-20210915185040-306161 status --alsologtostderr

multinode_test.go:356: (dbg) Run:  kubectl get nodes

multinode_test.go:364: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"

--- PASS: TestMultiNode/serial/RestartMultiNode (57.73s)

–

TestMultiNode/serial/ValidateNameConflict (25.06s)

=== RUN   TestMultiNode/serial/ValidateNameConflict

multinode_test.go:425: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-20210915185040-306161

multinode_test.go:434: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185040-306161-m02 --driver=docker  --container-runtime=docker

multinode_test.go:434: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20210915185040-306161-m02 --driver=docker  --container-runtime=docker: exit status 14 (103.690417ms)

-- stdout --

	* [multinode-20210915185040-306161-m02] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	  - MINIKUBE_LOCATION=12425

-- /stdout --

** stderr **

	! Profile name 'multinode-20210915185040-306161-m02' is duplicated with machine name 'multinode-20210915185040-306161-m02' in profile 'multinode-20210915185040-306161'

	X Exiting due to MK_USAGE: Profile name should be unique

** /stderr **

multinode_test.go:442: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-20210915185040-306161-m03 --driver=docker  --container-runtime=docker

multinode_test.go:442: (dbg) Done: out/minikube-linux-amd64 start -p multinode-20210915185040-306161-m03 --driver=docker  --container-runtime=docker: (21.923940861s)

multinode_test.go:449: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-20210915185040-306161

multinode_test.go:449: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-20210915185040-306161: exit status 80 (352.044673ms)

-- stdout --

	* Adding node m03 to cluster multinode-20210915185040-306161

-- /stdout --

** stderr **

	X Exiting due to GUEST_NODE_ADD: Node multinode-20210915185040-306161-m03 already exists in multinode-20210915185040-306161-m03 profile

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:454: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-20210915185040-306161-m03

multinode_test.go:454: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-20210915185040-306161-m03: (2.621428712s)

--- PASS: TestMultiNode/serial/ValidateNameConflict (25.06s)

–

TestDebPackageInstall/install_amd64_debian_sid/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_debian_sid/minikube

--- PASS: TestDebPackageInstall/install_amd64_debian_sid/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver (11.86s)

=== RUN   TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:sid sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:sid sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (11.858692187s)

--- PASS: TestDebPackageInstall/install_amd64_debian_sid/kvm2-driver (11.86s)

–

TestDebPackageInstall/install_amd64_debian_latest/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_debian_latest/minikube

--- PASS: TestDebPackageInstall/install_amd64_debian_latest/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver (10.18s)

=== RUN   TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (10.18267067s)

--- PASS: TestDebPackageInstall/install_amd64_debian_latest/kvm2-driver (10.18s)

–

TestDebPackageInstall/install_amd64_debian_10/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_debian_10/minikube

--- PASS: TestDebPackageInstall/install_amd64_debian_10/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_debian_10/kvm2-driver (10.03s)

=== RUN   TestDebPackageInstall/install_amd64_debian_10/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (10.026953981s)

--- PASS: TestDebPackageInstall/install_amd64_debian_10/kvm2-driver (10.03s)

–

TestDebPackageInstall/install_amd64_debian_9/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_debian_9/minikube

--- PASS: TestDebPackageInstall/install_amd64_debian_9/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_debian_9/kvm2-driver (8.28s)

=== RUN   TestDebPackageInstall/install_amd64_debian_9/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:9 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp debian:9 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (8.278827156s)

--- PASS: TestDebPackageInstall/install_amd64_debian_9/kvm2-driver (8.28s)

–

TestDebPackageInstall/install_amd64_ubuntu_latest/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_latest/minikube

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_latest/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver (126.64s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

E0915 18:57:51.090973  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:58:18.777546  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 18:59:04.944667  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:latest sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m6.641472767s)

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_latest/kvm2-driver (126.64s)

–

TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.10/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver (131.59s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:20.10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:20.10 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m11.592219654s)

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver (131.59s)

–

TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.04/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver (130.33s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:20.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

E0915 19:02:51.090969  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:20.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m10.327905835s)

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_20.04/kvm2-driver (130.33s)

–

TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube (0s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_18.04/minikube (0.00s)

–

TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver (152.82s)

=== RUN   TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver

pkg_install_test.go:106: (dbg) Run:  docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:18.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb"

E0915 19:04:04.945355  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 19:05:27.989744  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

pkg_install_test.go:106: (dbg) Done: docker run --rm -v/home/jenkins/workspace/Docker_Linux_integration/out:/var/tmp ubuntu:18.04 sh -c "apt-get update; apt-get install -y libvirt0; dpkg -i /var/tmp/docker-machine-driver-kvm2_1.23.0-0_amd64.deb": (2m32.815538971s)

--- PASS: TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver (152.82s)

–

TestPreload (115.12s)

=== RUN   TestPreload

preload_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20210915190619-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.17.0

preload_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20210915190619-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.17.0: (1m13.335979163s)

preload_test.go:62: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20210915190619-306161 -- docker pull busybox

preload_test.go:62: (dbg) Done: out/minikube-linux-amd64 ssh -p test-preload-20210915190619-306161 -- docker pull busybox: (2.458205563s)

preload_test.go:72: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-20210915190619-306161 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker --kubernetes-version=v1.17.3

E0915 19:07:51.091165  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

preload_test.go:72: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-20210915190619-306161 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker --kubernetes-version=v1.17.3: (33.810522591s)

preload_test.go:81: (dbg) Run:  out/minikube-linux-amd64 ssh -p test-preload-20210915190619-306161 -- docker images

helpers_test.go:176: Cleaning up "test-preload-20210915190619-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-20210915190619-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-20210915190619-306161: (5.133815709s)

--- PASS: TestPreload (115.12s)

–

TestScheduledStopUnix (67.03s)

=== RUN   TestScheduledStopUnix

scheduled_stop_test.go:129: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-20210915190814-306161 --memory=2048 --driver=docker  --container-runtime=docker

scheduled_stop_test.go:129: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-20210915190814-306161 --memory=2048 --driver=docker  --container-runtime=docker: (21.675202834s)

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915190814-306161 --schedule 5m

scheduled_stop_test.go:192: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-20210915190814-306161 -n scheduled-stop-20210915190814-306161

scheduled_stop_test.go:170: signal error was:  <nil>

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915190814-306161 --schedule 8s

scheduled_stop_test.go:170: signal error was:  os: process already finished

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915190814-306161 --cancel-scheduled

scheduled_stop_test.go:177: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915190814-306161 -n scheduled-stop-20210915190814-306161

scheduled_stop_test.go:177: (dbg) Done: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915190814-306161 -n scheduled-stop-20210915190814-306161: (5.047029162s)

scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20210915190814-306161

scheduled_stop_test.go:138: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-20210915190814-306161 --schedule 5s

scheduled_stop_test.go:170: signal error was:  os: process already finished

E0915 19:09:04.945108  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 19:09:14.140020  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

scheduled_stop_test.go:206: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-20210915190814-306161

scheduled_stop_test.go:206: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-20210915190814-306161: exit status 7 (104.502068ms)

-- stdout --

	scheduled-stop-20210915190814-306161

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

scheduled_stop_test.go:177: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915190814-306161 -n scheduled-stop-20210915190814-306161

scheduled_stop_test.go:177: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-20210915190814-306161 -n scheduled-stop-20210915190814-306161: exit status 7 (93.047473ms)

-- stdout --

	Stopped

-- /stdout --

scheduled_stop_test.go:177: status error: exit status 7 (may be ok)

helpers_test.go:176: Cleaning up "scheduled-stop-20210915190814-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-20210915190814-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-20210915190814-306161: (2.002383416s)

--- PASS: TestScheduledStopUnix (67.03s)

–

TestSkaffold (69.52s)

=== RUN   TestSkaffold

skaffold_test.go:58: (dbg) Run:  /tmp/skaffold.exe2098853717 version

skaffold_test.go:62: skaffold version: v1.31.0

skaffold_test.go:65: (dbg) Run:  out/minikube-linux-amd64 start -p skaffold-20210915190921-306161 --memory=2600 --driver=docker  --container-runtime=docker

skaffold_test.go:65: (dbg) Done: out/minikube-linux-amd64 start -p skaffold-20210915190921-306161 --memory=2600 --driver=docker  --container-runtime=docker: (21.950565007s)

skaffold_test.go:85: copying out/minikube-linux-amd64 to /home/jenkins/workspace/Docker_Linux_integration/out/minikube

skaffold_test.go:109: (dbg) Run:  /tmp/skaffold.exe2098853717 run --minikube-profile skaffold-20210915190921-306161 --kube-context skaffold-20210915190921-306161 --status-check=true --port-forward=false --interactive=false

skaffold_test.go:109: (dbg) Done: /tmp/skaffold.exe2098853717 run --minikube-profile skaffold-20210915190921-306161 --kube-context skaffold-20210915190921-306161 --status-check=true --port-forward=false --interactive=false: (33.159199209s)

skaffold_test.go:115: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...

helpers_test.go:343: "leeroy-app-7b7b8cf76f-hdjd9" [c9157b93-4b3e-4673-b23d-3ea61ad83efc] Running

skaffold_test.go:115: (dbg) TestSkaffold: app=leeroy-app healthy within 5.012019899s

skaffold_test.go:118: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...

helpers_test.go:343: "leeroy-web-5db657c9bd-p6czw" [95a29841-f6d8-4509-a3c4-c2c76527df3a] Running

skaffold_test.go:118: (dbg) TestSkaffold: app=leeroy-web healthy within 5.005988385s

helpers_test.go:176: Cleaning up "skaffold-20210915190921-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p skaffold-20210915190921-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p skaffold-20210915190921-306161: (3.816532452s)

--- PASS: TestSkaffold (69.52s)

–

TestInsufficientStorage (9.53s)

=== RUN   TestInsufficientStorage

status_test.go:51: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-20210915191030-306161 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker

status_test.go:51: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-20210915191030-306161 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (6.721179007s)

-- stdout --

	{"specversion":"1.0","id":"297907eb-6bd1-439f-a091-13ab66d37006","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-20210915191030-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"26f827a2-0b4c-47ef-95ff-a95ef47baadf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig"}}

	{"specversion":"1.0","id":"d9fdd7f1-6290-4d87-b80b-3b4326ed6816","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}

	{"specversion":"1.0","id":"afd05edf-d927-4b48-99bd-fab7dbaad3ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube"}}

	{"specversion":"1.0","id":"2f14b060-e0dd-4120-915e-cc5a0fe31755","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=12425"}}

	{"specversion":"1.0","id":"de68589c-9d00-41f9-b474-2b56069d3406","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}

	{"specversion":"1.0","id":"4f1dfccc-f22d-4f79-aa03-5ee801155423","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"2db5a295-0352-482d-9e21-e8e246313bdd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"Your cgroup does not allow setting memory."}}

	{"specversion":"1.0","id":"db3143b4-4d42-4973-a156-a2b22b89b15e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities"}}

	{"specversion":"1.0","id":"4f55e840-0cc1-4819-9c51-43aed9ad6825","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-20210915191030-306161 in cluster insufficient-storage-20210915191030-306161","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"e617d916-44e1-4338-b4dc-98ca20959201","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}

	{"specversion":"1.0","id":"da88459e-5735-40c1-bc3f-163ea47cdf98","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}

	{"specversion":"1.0","id":"351cd889-2af9-4ae1-b9cb-13ee181aa2fc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity)","name":"RSRC_DOCKER_STORAGE","url":""}}

-- /stdout --

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20210915191030-306161 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20210915191030-306161 --output=json --layout=cluster: exit status 7 (364.874261ms)

-- stdout --

	{"Name":"insufficient-storage-20210915191030-306161","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.23.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20210915191030-306161","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr **

	E0915 19:10:38.037738  457597 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20210915191030-306161" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

** /stderr **

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-20210915191030-306161 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-20210915191030-306161 --output=json --layout=cluster: exit status 7 (358.12026ms)

-- stdout --

	{"Name":"insufficient-storage-20210915191030-306161","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.23.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-20210915191030-306161","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

** stderr **

	E0915 19:10:38.395897  457698 status.go:413] kubeconfig endpoint: extract IP: "insufficient-storage-20210915191030-306161" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	E0915 19:10:38.408593  457698 status.go:557] unable to read event log: stat: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/insufficient-storage-20210915191030-306161/events.json: no such file or directory

** /stderr **

helpers_test.go:176: Cleaning up "insufficient-storage-20210915191030-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-20210915191030-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-20210915191030-306161: (2.083907532s)

--- PASS: TestInsufficientStorage (9.53s)

–

TestRunningBinaryUpgrade (112.26s)

=== RUN   TestRunningBinaryUpgrade

=== PAUSE TestRunningBinaryUpgrade

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:128: (dbg) Run:  /tmp/minikube-v1.9.0.1325195075.exe start -p running-upgrade-20210915191229-306161 --memory=2200 --vm-driver=docker  --container-runtime=docker

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:128: (dbg) Done: /tmp/minikube-v1.9.0.1325195075.exe start -p running-upgrade-20210915191229-306161 --memory=2200 --vm-driver=docker  --container-runtime=docker: (56.920908064s)

version_upgrade_test.go:138: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-20210915191229-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:138: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-20210915191229-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (51.775948052s)

helpers_test.go:176: Cleaning up "running-upgrade-20210915191229-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-20210915191229-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-20210915191229-306161: (3.04597501s)

--- PASS: TestRunningBinaryUpgrade (112.26s)

–

TestKubernetesUpgrade (107.91s)

=== RUN   TestKubernetesUpgrade

=== PAUSE TestKubernetesUpgrade

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:226: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:226: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (37.499776197s)

version_upgrade_test.go:231: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-20210915191207-306161

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:231: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20210915191207-306161: (11.021820488s)

version_upgrade_test.go:236: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20210915191207-306161 status --format={{.Host}}

version_upgrade_test.go:236: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20210915191207-306161 status --format={{.Host}}: exit status 7 (94.124536ms)

-- stdout --

	Stopped

-- /stdout --

version_upgrade_test.go:238: status error: exit status 7 (may be ok)

version_upgrade_test.go:247: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:247: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (29.78158385s)

version_upgrade_test.go:252: (dbg) Run:  kubectl --context kubernetes-upgrade-20210915191207-306161 version --output=json

version_upgrade_test.go:271: Attempting to downgrade Kubernetes (should fail)

version_upgrade_test.go:273: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.14.0 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:273: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.14.0 --driver=docker  --container-runtime=docker: exit status 106 (167.37055ms)

-- stdout --

	* [kubernetes-upgrade-20210915191207-306161] minikube v1.23.0 on Debian 9.13 (kvm/amd64)

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/kubeconfig

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube

	  - MINIKUBE_LOCATION=12425

-- /stdout --

** stderr **

	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.22.2-rc.0 cluster to v1.14.0

	* Suggestion:

	    1) Recreate the cluster with Kubernetes 1.14.0, by running:

	    minikube delete -p kubernetes-upgrade-20210915191207-306161

	    minikube start -p kubernetes-upgrade-20210915191207-306161 --kubernetes-version=v1.14.0

	    2) Create a second cluster with Kubernetes 1.14.0, by running:

	    minikube start -p kubernetes-upgrade-20210915191207-3061612 --kubernetes-version=v1.14.0

	    3) Use the existing cluster at version Kubernetes 1.22.2-rc.0, by running:

	    minikube start -p kubernetes-upgrade-20210915191207-306161 --kubernetes-version=v1.22.2-rc.0

** /stderr **

version_upgrade_test.go:277: Attempting restart after unsuccessful downgrade

version_upgrade_test.go:279: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:279: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20210915191207-306161 --memory=2200 --kubernetes-version=v1.22.2-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (25.768364858s)

helpers_test.go:176: Cleaning up "kubernetes-upgrade-20210915191207-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-20210915191207-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20210915191207-306161: (3.485477126s)

--- PASS: TestKubernetesUpgrade (107.91s)

–

TestMissingContainerUpgrade (117.01s)

=== RUN   TestMissingContainerUpgrade

=== PAUSE TestMissingContainerUpgrade

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:313: (dbg) Run:  /tmp/minikube-v1.9.1.113933478.exe start -p missing-upgrade-20210915191150-306161 --memory=2200 --driver=docker  --container-runtime=docker

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:313: (dbg) Done: /tmp/minikube-v1.9.1.113933478.exe start -p missing-upgrade-20210915191150-306161 --memory=2200 --driver=docker  --container-runtime=docker: (52.673213254s)

version_upgrade_test.go:322: (dbg) Run:  docker stop missing-upgrade-20210915191150-306161

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:322: (dbg) Done: docker stop missing-upgrade-20210915191150-306161: (1.881713216s)

version_upgrade_test.go:327: (dbg) Run:  docker rm missing-upgrade-20210915191150-306161

version_upgrade_test.go:333: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-20210915191150-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

E0915 19:12:51.090690  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:333: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-20210915191150-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (58.019580214s)

helpers_test.go:176: Cleaning up "missing-upgrade-20210915191150-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-20210915191150-306161

helpers_test.go:179: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-20210915191150-306161: (3.170221332s)

--- PASS: TestMissingContainerUpgrade (117.01s)

–

TestPause/serial/Start (62.49s)

=== RUN   TestPause/serial/Start

=== CONT  TestPause/serial/Start

pause_test.go:78: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20210915191040-306161 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker

=== CONT  TestPause/serial/Start

pause_test.go:78: (dbg) Done: out/minikube-linux-amd64 start -p pause-20210915191040-306161 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m2.494575725s)

--- PASS: TestPause/serial/Start (62.49s)

–

TestStoppedBinaryUpgrade/Upgrade (103.53s)

=== RUN   TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:187: (dbg) Run:  /tmp/minikube-v1.9.0.3660692216.exe start -p stopped-upgrade-20210915191040-306161 --memory=2200 --vm-driver=docker  --container-runtime=docker

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:187: (dbg) Done: /tmp/minikube-v1.9.0.3660692216.exe start -p stopped-upgrade-20210915191040-306161 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m8.778658721s)

version_upgrade_test.go:196: (dbg) Run:  /tmp/minikube-v1.9.0.3660692216.exe -p stopped-upgrade-20210915191040-306161 stop

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:196: (dbg) Done: /tmp/minikube-v1.9.0.3660692216.exe -p stopped-upgrade-20210915191040-306161 stop: (2.828241038s)

version_upgrade_test.go:202: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-20210915191040-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:202: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-20210915191040-306161 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (31.920527685s)

--- PASS: TestStoppedBinaryUpgrade/Upgrade (103.53s)

–

TestPause/serial/SecondStartNoReconfiguration (9.17s)

=== RUN   TestPause/serial/SecondStartNoReconfiguration

pause_test.go:90: (dbg) Run:  out/minikube-linux-amd64 start -p pause-20210915191040-306161 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestPause/serial/SecondStartNoReconfiguration

pause_test.go:90: (dbg) Done: out/minikube-linux-amd64 start -p pause-20210915191040-306161 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (9.150412275s)

--- PASS: TestPause/serial/SecondStartNoReconfiguration (9.17s)

–

TestPause/serial/Pause (0.79s)

=== RUN   TestPause/serial/Pause

pause_test.go:108: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-20210915191040-306161 --alsologtostderr -v=5

--- PASS: TestPause/serial/Pause (0.79s)

–

TestPause/serial/VerifyStatus (0.52s)

=== RUN   TestPause/serial/VerifyStatus

status_test.go:77: (dbg) Run:  out/minikube-linux-amd64 status -p pause-20210915191040-306161 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-20210915191040-306161 --output=json --layout=cluster: exit status 2 (516.850066ms)

-- stdout --

	{"Name":"pause-20210915191040-306161","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 14 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.23.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-20210915191040-306161","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

-- /stdout --

--- PASS: TestPause/serial/VerifyStatus (0.52s)

–

TestPause/serial/Unpause (2.33s)

=== RUN   TestPause/serial/Unpause

pause_test.go:119: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-20210915191040-306161 --alsologtostderr -v=5

pause_test.go:119: (dbg) Done: out/minikube-linux-amd64 unpause -p pause-20210915191040-306161 --alsologtostderr -v=5: (2.330966175s)

--- PASS: TestPause/serial/Unpause (2.33s)

–

TestStoppedBinaryUpgrade/MinikubeLogs (1.65s)

=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs

version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-20210915191040-306161

version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-20210915191040-306161: (1.652089183s)

--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.65s)

–

TestPause/serial/DeletePaused (3.02s)

=== RUN   TestPause/serial/DeletePaused

pause_test.go:130: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-20210915191040-306161 --alsologtostderr -v=5

=== CONT  TestPause/serial/DeletePaused

pause_test.go:130: (dbg) Done: out/minikube-linux-amd64 delete -p pause-20210915191040-306161 --alsologtostderr -v=5: (3.024879225s)

--- PASS: TestPause/serial/DeletePaused (3.02s)

–

TestPause/serial/VerifyDeletedResources (11.49s)

=== RUN   TestPause/serial/VerifyDeletedResources

pause_test.go:140: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

pause_test.go:140: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (11.382580263s)

pause_test.go:166: (dbg) Run:  docker ps -a

pause_test.go:171: (dbg) Run:  docker volume inspect pause-20210915191040-306161

pause_test.go:171: (dbg) Non-zero exit: docker volume inspect pause-20210915191040-306161: exit status 1 (52.134676ms)

-- stdout --

[]

-- /stdout --

** stderr **

	Error: No such volume: pause-20210915191040-306161

** /stderr **

--- PASS: TestPause/serial/VerifyDeletedResources (11.49s)

–

TestNetworkPlugins/group/auto/Start (95.35s)

=== RUN   TestNetworkPlugins/group/auto/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p auto-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/auto/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p auto-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker  --container-runtime=docker: (1m35.346897507s)

--- PASS: TestNetworkPlugins/group/auto/Start (95.35s)

–

TestNetworkPlugins/group/false/Start (51.51s)

=== RUN   TestNetworkPlugins/group/false/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p false-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=false --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/false/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p false-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=false --driver=docker  --container-runtime=docker: (51.513437161s)

--- PASS: TestNetworkPlugins/group/false/Start (51.51s)

–

TestNetworkPlugins/group/cilium/Start (112.28s)

=== RUN   TestNetworkPlugins/group/cilium/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p cilium-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=docker

E0915 19:14:04.942425  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/cilium/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p cilium-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker  --container-runtime=docker: (1m52.275742211s)

--- PASS: TestNetworkPlugins/group/cilium/Start (112.28s)

–

TestNetworkPlugins/group/calico/Start (76.62s)

=== RUN   TestNetworkPlugins/group/calico/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p calico-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/calico/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p calico-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker  --container-runtime=docker: (1m16.620452377s)

--- PASS: TestNetworkPlugins/group/calico/Start (76.62s)

–

TestNetworkPlugins/group/false/KubeletFlags (0.42s)

=== RUN   TestNetworkPlugins/group/false/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p false-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.42s)

–

TestNetworkPlugins/group/false/NetCatPod (11.19s)

=== RUN   TestNetworkPlugins/group/false/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context false-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-9kr7j" [7e3ca465-9a0b-478d-91ce-0d23c18750b6] Pending

helpers_test.go:343: "netcat-66fbc655d5-9kr7j" [7e3ca465-9a0b-478d-91ce-0d23c18750b6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

helpers_test.go:343: "netcat-66fbc655d5-9kr7j" [7e3ca465-9a0b-478d-91ce-0d23c18750b6] Running

net_test.go:146: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 11.005086115s

--- PASS: TestNetworkPlugins/group/false/NetCatPod (11.19s)

–

TestNetworkPlugins/group/false/DNS (0.25s)

=== RUN   TestNetworkPlugins/group/false/DNS

net_test.go:163: (dbg) Run:  kubectl --context false-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/false/DNS (0.25s)

–

TestNetworkPlugins/group/false/Localhost (0.17s)

=== RUN   TestNetworkPlugins/group/false/Localhost

net_test.go:182: (dbg) Run:  kubectl --context false-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/false/Localhost (0.17s)

–

TestNetworkPlugins/group/false/HairPin (5.17s)

=== RUN   TestNetworkPlugins/group/false/HairPin

net_test.go:232: (dbg) Run:  kubectl --context false-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

net_test.go:232: (dbg) Non-zero exit: kubectl --context false-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080": exit status 1 (5.166355764s)

** stderr **

	command terminated with exit code 1

** /stderr **

--- PASS: TestNetworkPlugins/group/false/HairPin (5.17s)

–

TestNetworkPlugins/group/custom-weave/Start (57.84s)

=== RUN   TestNetworkPlugins/group/custom-weave/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p custom-weave-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=docker

E0915 19:15:17.121555  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.126839  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.137130  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.158263  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.199454  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.279752  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.440638  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:17.761696  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:18.402445  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:19.682948  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:15:22.243101  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/custom-weave/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p custom-weave-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker  --container-runtime=docker: (57.836206509s)

--- PASS: TestNetworkPlugins/group/custom-weave/Start (57.84s)

–

TestNetworkPlugins/group/auto/KubeletFlags (0.48s)

=== RUN   TestNetworkPlugins/group/auto/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.48s)

–

TestNetworkPlugins/group/auto/NetCatPod (9.43s)

=== RUN   TestNetworkPlugins/group/auto/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context auto-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-glsxt" [5442b538-7efe-4873-b753-32614be67789] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

E0915 19:15:27.363382  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

helpers_test.go:343: "netcat-66fbc655d5-glsxt" [5442b538-7efe-4873-b753-32614be67789] Running

net_test.go:146: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.008722298s

--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.43s)

–

TestNetworkPlugins/group/auto/DNS (0.18s)

=== RUN   TestNetworkPlugins/group/auto/DNS

net_test.go:163: (dbg) Run:  kubectl --context auto-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/auto/DNS (0.18s)

–

TestNetworkPlugins/group/auto/Localhost (0.15s)

=== RUN   TestNetworkPlugins/group/auto/Localhost

net_test.go:182: (dbg) Run:  kubectl --context auto-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/auto/Localhost (0.15s)

–

TestNetworkPlugins/group/auto/HairPin (5.16s)

=== RUN   TestNetworkPlugins/group/auto/HairPin

net_test.go:232: (dbg) Run:  kubectl --context auto-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

E0915 19:15:37.603701  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/auto/HairPin

net_test.go:232: (dbg) Non-zero exit: kubectl --context auto-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080": exit status 1 (5.156952432s)

** stderr **

	command terminated with exit code 1

** /stderr **

--- PASS: TestNetworkPlugins/group/auto/HairPin (5.16s)

–

TestNetworkPlugins/group/calico/ControllerPod (5.02s)

=== RUN   TestNetworkPlugins/group/calico/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...

helpers_test.go:343: "calico-node-x6s8c" [ecd97346-3e26-46ef-bc55-7f0418986876] Running

=== CONT  TestNetworkPlugins/group/calico/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.01454779s

--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.02s)

–

TestNetworkPlugins/group/calico/KubeletFlags (0.43s)

=== RUN   TestNetworkPlugins/group/calico/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.43s)

–

TestNetworkPlugins/group/bridge/Start (46.75s)

=== RUN   TestNetworkPlugins/group/bridge/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/bridge/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p bridge-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=bridge --driver=docker  --container-runtime=docker: (46.746609451s)

--- PASS: TestNetworkPlugins/group/bridge/Start (46.75s)

–

TestNetworkPlugins/group/calico/NetCatPod (14.46s)

=== RUN   TestNetworkPlugins/group/calico/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context calico-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-k9pt6" [5362fb27-97bb-418e-be77-8f46dbfc90e9] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/calico/NetCatPod

helpers_test.go:343: "netcat-66fbc655d5-k9pt6" [5362fb27-97bb-418e-be77-8f46dbfc90e9] Running

=== CONT  TestNetworkPlugins/group/calico/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 14.062005545s

--- PASS: TestNetworkPlugins/group/calico/NetCatPod (14.46s)

–

TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

=== RUN   TestNetworkPlugins/group/cilium/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: waiting 10m0s for pods matching "k8s-app=cilium" in namespace "kube-system" ...

helpers_test.go:343: "cilium-pz8nw" [b417e581-cdda-4e1b-9ac4-097e095070cf] Running

=== CONT  TestNetworkPlugins/group/cilium/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/cilium/ControllerPod: k8s-app=cilium healthy within 5.019800682s

--- PASS: TestNetworkPlugins/group/cilium/ControllerPod (5.02s)

–

TestNetworkPlugins/group/cilium/KubeletFlags (0.43s)

=== RUN   TestNetworkPlugins/group/cilium/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p cilium-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/cilium/KubeletFlags (0.43s)

–

TestNetworkPlugins/group/calico/DNS (0.21s)

=== RUN   TestNetworkPlugins/group/calico/DNS

net_test.go:163: (dbg) Run:  kubectl --context calico-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/calico/DNS (0.21s)

–

TestNetworkPlugins/group/cilium/NetCatPod (10.5s)

=== RUN   TestNetworkPlugins/group/cilium/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context cilium-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

E0915 19:15:58.084609  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

=== CONT  TestNetworkPlugins/group/cilium/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-bknz6" [757b2960-5c27-4dfb-86e3-cceb2bc4320b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/cilium/NetCatPod

helpers_test.go:343: "netcat-66fbc655d5-bknz6" [757b2960-5c27-4dfb-86e3-cceb2bc4320b] Running

=== CONT  TestNetworkPlugins/group/cilium/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/cilium/NetCatPod: app=netcat healthy within 10.007306698s

--- PASS: TestNetworkPlugins/group/cilium/NetCatPod (10.50s)

–

TestNetworkPlugins/group/calico/Localhost (0.19s)

=== RUN   TestNetworkPlugins/group/calico/Localhost

net_test.go:182: (dbg) Run:  kubectl --context calico-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/calico/Localhost (0.19s)

–

TestNetworkPlugins/group/calico/HairPin (0.22s)

=== RUN   TestNetworkPlugins/group/calico/HairPin

net_test.go:232: (dbg) Run:  kubectl --context calico-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/calico/HairPin (0.22s)

–

TestNetworkPlugins/group/kindnet/Start (76.56s)

=== RUN   TestNetworkPlugins/group/kindnet/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/kindnet/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=kindnet --driver=docker  --container-runtime=docker: (1m16.562747804s)

--- PASS: TestNetworkPlugins/group/kindnet/Start (76.56s)

–

TestNetworkPlugins/group/custom-weave/KubeletFlags (0.44s)

=== RUN   TestNetworkPlugins/group/custom-weave/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-weave-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/custom-weave/KubeletFlags (0.44s)

–

TestNetworkPlugins/group/custom-weave/NetCatPod (11.34s)

=== RUN   TestNetworkPlugins/group/custom-weave/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context custom-weave-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-422sc" [93ef24ac-0a8e-4925-95b1-9570d0615682] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/custom-weave/NetCatPod

helpers_test.go:343: "netcat-66fbc655d5-422sc" [93ef24ac-0a8e-4925-95b1-9570d0615682] Running

=== CONT  TestNetworkPlugins/group/custom-weave/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/custom-weave/NetCatPod: app=netcat healthy within 11.107450844s

--- PASS: TestNetworkPlugins/group/custom-weave/NetCatPod (11.34s)

–

TestNetworkPlugins/group/cilium/DNS (0.22s)

=== RUN   TestNetworkPlugins/group/cilium/DNS

net_test.go:163: (dbg) Run:  kubectl --context cilium-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/cilium/DNS (0.22s)

–

TestNetworkPlugins/group/cilium/Localhost (0.18s)

=== RUN   TestNetworkPlugins/group/cilium/Localhost

net_test.go:182: (dbg) Run:  kubectl --context cilium-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/cilium/Localhost (0.18s)

–

TestNetworkPlugins/group/cilium/HairPin (0.18s)

=== RUN   TestNetworkPlugins/group/cilium/HairPin

net_test.go:232: (dbg) Run:  kubectl --context cilium-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/cilium/HairPin (0.18s)

–

TestNetworkPlugins/group/enable-default-cni/Start (58.81s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/enable-default-cni/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker  --container-runtime=docker: (58.81465949s)

--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (58.81s)

–

TestNetworkPlugins/group/kubenet/Start (53.04s)

=== RUN   TestNetworkPlugins/group/kubenet/Start

net_test.go:99: (dbg) Run:  out/minikube-linux-amd64 start -p kubenet-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --network-plugin=kubenet --driver=docker  --container-runtime=docker

=== CONT  TestNetworkPlugins/group/kubenet/Start

net_test.go:99: (dbg) Done: out/minikube-linux-amd64 start -p kubenet-20210915191040-306161 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (53.036704956s)

--- PASS: TestNetworkPlugins/group/kubenet/Start (53.04s)

–

TestNetworkPlugins/group/bridge/KubeletFlags (0.46s)

=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.46s)

–

TestNetworkPlugins/group/bridge/NetCatPod (10.26s)

=== RUN   TestNetworkPlugins/group/bridge/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context bridge-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-7s92h" [1d0ce2f3-d5be-40d9-b5d3-955aa0fd1a02] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

helpers_test.go:343: "netcat-66fbc655d5-7s92h" [1d0ce2f3-d5be-40d9-b5d3-955aa0fd1a02] Running

E0915 19:16:39.045259  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

net_test.go:146: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.007312743s

--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.26s)

–

TestNetworkPlugins/group/bridge/DNS (0.2s)

=== RUN   TestNetworkPlugins/group/bridge/DNS

net_test.go:163: (dbg) Run:  kubectl --context bridge-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/bridge/DNS (0.20s)

–

TestNetworkPlugins/group/bridge/Localhost (0.2s)

=== RUN   TestNetworkPlugins/group/bridge/Localhost

net_test.go:182: (dbg) Run:  kubectl --context bridge-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.20s)

–

TestNetworkPlugins/group/bridge/HairPin (0.18s)

=== RUN   TestNetworkPlugins/group/bridge/HairPin

net_test.go:232: (dbg) Run:  kubectl --context bridge-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.18s)

–

TestStartStop/group/old-k8s-version/serial/FirstStart (133.28s)

=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20210915191644-306161 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.14.0

=== CONT  TestStartStop/group/old-k8s-version/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20210915191644-306161 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.14.0: (2m13.284368149s)

--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (133.28s)

–

TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.4s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.40s)

–

TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.29s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context enable-default-cni-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-9v2vh" [bdca7c31-662d-433b-9a9a-b4edf13f9b48] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

helpers_test.go:343: "netcat-66fbc655d5-9v2vh" [bdca7c31-662d-433b-9a9a-b4edf13f9b48] Running

=== CONT  TestNetworkPlugins/group/enable-default-cni/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.016820523s

--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.29s)

–

TestNetworkPlugins/group/kindnet/ControllerPod (6.09s)

=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...

helpers_test.go:343: "kindnet-bm29n" [acc81f44-65b2-4deb-943a-919b4a20d0ad] Running

=== CONT  TestNetworkPlugins/group/kindnet/ControllerPod

net_test.go:107: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.090290513s

--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.09s)

–

TestNetworkPlugins/group/kubenet/KubeletFlags (0.39s)

=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p kubenet-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.39s)

–

TestNetworkPlugins/group/kubenet/NetCatPod (12.21s)

=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context kubenet-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-2phsd" [2c60d183-96ca-4f01-a7e0-83169573415b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/kubenet/NetCatPod

helpers_test.go:343: "netcat-66fbc655d5-2phsd" [2c60d183-96ca-4f01-a7e0-83169573415b] Running

=== CONT  TestNetworkPlugins/group/kubenet/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 12.006764415s

--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (12.21s)

–

TestNetworkPlugins/group/enable-default-cni/DNS (0.19s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS

net_test.go:163: (dbg) Run:  kubectl --context enable-default-cni-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.19s)

–

TestNetworkPlugins/group/enable-default-cni/Localhost (0.19s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost

net_test.go:182: (dbg) Run:  kubectl --context enable-default-cni-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.19s)

–

TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin

net_test.go:232: (dbg) Run:  kubectl --context enable-default-cni-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)

–

TestNetworkPlugins/group/kindnet/KubeletFlags (0.52s)

=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags

net_test.go:120: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-20210915191040-306161 "pgrep -a kubelet"

--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.52s)

–

TestNetworkPlugins/group/kindnet/NetCatPod (9.27s)

=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod

net_test.go:132: (dbg) Run:  kubectl --context kindnet-20210915191040-306161 replace --force -f testdata/netcat-deployment.yaml

net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...

helpers_test.go:343: "netcat-66fbc655d5-gnp87" [7df1b82d-4221-49f5-96c7-653e74a4d49d] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])

=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod

helpers_test.go:343: "netcat-66fbc655d5-gnp87" [7df1b82d-4221-49f5-96c7-653e74a4d49d] Running

=== CONT  TestNetworkPlugins/group/kindnet/NetCatPod

net_test.go:146: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.006751727s

--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.27s)

–

TestStartStop/group/no-preload/serial/FirstStart (75.17s)

=== RUN   TestStartStop/group/no-preload/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20210915191727-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0

=== CONT  TestStartStop/group/no-preload/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20210915191727-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0: (1m15.169278995s)

--- PASS: TestStartStop/group/no-preload/serial/FirstStart (75.17s)

–

TestNetworkPlugins/group/kubenet/DNS (0.23s)

=== RUN   TestNetworkPlugins/group/kubenet/DNS

net_test.go:163: (dbg) Run:  kubectl --context kubenet-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.23s)

–

TestNetworkPlugins/group/kubenet/Localhost (0.18s)

=== RUN   TestNetworkPlugins/group/kubenet/Localhost

net_test.go:182: (dbg) Run:  kubectl --context kubenet-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.18s)

–

TestNetworkPlugins/group/kubenet/HairPin (0.19s)

=== RUN   TestNetworkPlugins/group/kubenet/HairPin

net_test.go:232: (dbg) Run:  kubectl --context kubenet-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.19s)

–

TestNetworkPlugins/group/kindnet/DNS (0.29s)

=== RUN   TestNetworkPlugins/group/kindnet/DNS

net_test.go:163: (dbg) Run:  kubectl --context kindnet-20210915191040-306161 exec deployment/netcat -- nslookup kubernetes.default

--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.29s)

–

TestNetworkPlugins/group/kindnet/Localhost (0.24s)

=== RUN   TestNetworkPlugins/group/kindnet/Localhost

net_test.go:182: (dbg) Run:  kubectl --context kindnet-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"

--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.24s)

–

TestNetworkPlugins/group/kindnet/HairPin (0.2s)

=== RUN   TestNetworkPlugins/group/kindnet/HairPin

net_test.go:232: (dbg) Run:  kubectl --context kindnet-20210915191040-306161 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"

--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.20s)

E0915 19:25:02.487763  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:25:03.283075  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:25:15.651183  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:25:17.121855  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:25:24.016476  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

–

TestStartStop/group/embed-certs/serial/FirstStart (285.25s)

=== RUN   TestStartStop/group/embed-certs/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20210915191735-306161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1

=== CONT  TestStartStop/group/embed-certs/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20210915191735-306161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1: (4m45.252845478s)

--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (285.25s)

–

TestStartStop/group/default-k8s-different-port/serial/FirstStart (54.74s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20210915191739-306161 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1

E0915 19:17:51.091533  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 19:18:00.966405  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20210915191739-306161 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1: (54.744392212s)

--- PASS: TestStartStop/group/default-k8s-different-port/serial/FirstStart (54.74s)

–

TestStartStop/group/default-k8s-different-port/serial/DeployApp (9.5s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20210915191739-306161 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [1197408c-75af-4323-8cb1-95ed451efe14] Pending

helpers_test.go:343: "busybox" [1197408c-75af-4323-8cb1-95ed451efe14] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [1197408c-75af-4323-8cb1-95ed451efe14] Running

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

start_stop_delete_test.go:181: (dbg) TestStartStop/group/default-k8s-different-port/serial/DeployApp: integration-test=busybox healthy within 9.014797282s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context default-k8s-different-port-20210915191739-306161 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/default-k8s-different-port/serial/DeployApp (9.50s)

–

TestStartStop/group/no-preload/serial/DeployApp (9.36s)

=== RUN   TestStartStop/group/no-preload/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20210915191727-306161 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [f5eb4b7d-f65e-470b-a003-bc642e70af89] Pending

=== CONT  TestStartStop/group/no-preload/serial/DeployApp

helpers_test.go:343: "busybox" [f5eb4b7d-f65e-470b-a003-bc642e70af89] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

=== CONT  TestStartStop/group/no-preload/serial/DeployApp

helpers_test.go:343: "busybox" [f5eb4b7d-f65e-470b-a003-bc642e70af89] Running

start_stop_delete_test.go:181: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.01158425s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context no-preload-20210915191727-306161 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.36s)

–

TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.75s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20210915191739-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

=== CONT  TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context default-k8s-different-port-20210915191739-306161 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.75s)

–

TestStartStop/group/default-k8s-different-port/serial/Stop (11.12s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-different-port-20210915191739-306161 --alsologtostderr -v=3

=== CONT  TestStartStop/group/default-k8s-different-port/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-different-port-20210915191739-306161 --alsologtostderr -v=3: (11.120986969s)

--- PASS: TestStartStop/group/default-k8s-different-port/serial/Stop (11.12s)

–

TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.68s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20210915191727-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context no-preload-20210915191727-306161 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.68s)

–

TestStartStop/group/no-preload/serial/Stop (11.13s)

=== RUN   TestStartStop/group/no-preload/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-20210915191727-306161 --alsologtostderr -v=3

=== CONT  TestStartStop/group/no-preload/serial/Stop

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-20210915191727-306161 --alsologtostderr -v=3: (11.129730085s)

--- PASS: TestStartStop/group/no-preload/serial/Stop (11.13s)

–

TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.2s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161: exit status 7 (95.377927ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-different-port-20210915191739-306161 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/default-k8s-different-port/serial/EnableAddonAfterStop (0.20s)

–

TestStartStop/group/default-k8s-different-port/serial/SecondStart (332.37s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-different-port-20210915191739-306161 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1

=== CONT  TestStartStop/group/default-k8s-different-port/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-different-port-20210915191739-306161 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1: (5m31.937016536s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

--- PASS: TestStartStop/group/default-k8s-different-port/serial/SecondStart (332.37s)

–

TestStartStop/group/old-k8s-version/serial/DeployApp (9.38s)

=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20210915191644-306161 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [c6bd2f71-1659-11ec-bc6f-02425e863475] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:343: "busybox" [c6bd2f71-1659-11ec-bc6f-02425e863475] Running

=== CONT  TestStartStop/group/old-k8s-version/serial/DeployApp

start_stop_delete_test.go:181: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.012116231s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context old-k8s-version-20210915191644-306161 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.38s)

–

TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.2s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161: exit status 7 (101.372309ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-20210915191727-306161 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.20s)

–

TestStartStop/group/no-preload/serial/SecondStart (332.79s)

=== RUN   TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-20210915191727-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0

E0915 19:19:04.942482  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

=== CONT  TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-20210915191727-306161 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0: (5m32.143470649s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

--- PASS: TestStartStop/group/no-preload/serial/SecondStart (332.79s)

–

TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.76s)

=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-20210915191644-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context old-k8s-version-20210915191644-306161 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.76s)

–

TestStartStop/group/old-k8s-version/serial/Stop (11.23s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-20210915191644-306161 --alsologtostderr -v=3

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-20210915191644-306161 --alsologtostderr -v=3: (11.232280559s)

--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.23s)

–

TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161: exit status 7 (102.655844ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-20210915191644-306161 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

–

TestStartStop/group/old-k8s-version/serial/SecondStart (413.24s)

=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-20210915191644-306161 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.14.0

E0915 19:19:47.967983  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:47.973295  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:47.983552  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:48.003812  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:48.044233  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:48.124582  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:48.285024  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:48.605528  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:49.245740  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:50.525997  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:53.086910  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:19:58.207325  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:08.448287  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:17.121581  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:20:24.016630  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.021863  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.032029  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.052341  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.092629  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.173031  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.333448  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:24.654011  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:25.294689  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:26.575689  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:28.929475  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:29.136829  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:34.257458  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.024701  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.029987  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.040234  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.060492  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.100750  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.181465  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.341896  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:38.662822  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:39.303541  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:40.584256  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:43.144976  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:44.498226  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:44.806657  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/skaffold-20210915190921-306161/client.crt: no such file or directory

E0915 19:20:48.265742  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.584326  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.589672  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.599906  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.620163  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.660437  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.740799  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:52.900990  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:53.222280  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:53.862814  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:55.143283  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:57.703724  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:20:58.506838  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:02.824587  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:04.979111  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:06.844743  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:06.850123  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:06.860631  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:06.880967  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:06.922107  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:07.002973  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:07.164025  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:07.484944  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:08.125455  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:09.406075  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:09.890472  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:11.966822  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:13.065738  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:17.087685  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:18.986999  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:27.327893  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.825052  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.830328  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.840566  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.860854  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.901229  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:30.981622  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:31.142130  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:31.462631  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:32.103115  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:33.383779  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:33.546740  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:35.944977  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:44.737592  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:45.940127  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:47.808780  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:54.978679  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:21:59.947347  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:07.990370  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 19:22:11.849969  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:11.855248  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:11.865423  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:11.885677  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:11.925962  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:12.006254  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:12.166663  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:12.487256  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:13.127967  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:14.408408  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:14.507653  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:15.459737  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:16.968964  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.644160  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.649449  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.659698  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.679972  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.720261  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.800678  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:18.961090  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.281543  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.440012  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.445275  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.455538  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.475794  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.516049  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.596388  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.757368  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:19.922467  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:20.077736  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:20.718928  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

=== CONT  TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-20210915191644-306161 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.14.0: (6m52.845533083s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (413.24s)

–

TestStartStop/group/embed-certs/serial/DeployApp (12.32s)

=== RUN   TestStartStop/group/embed-certs/serial/DeployApp

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 create -f testdata/busybox.yaml

start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:343: "busybox" [fb2236a7-f671-4e92-a1f5-91ee1f4ed836] Pending

E0915 19:22:21.203441  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:21.999498  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:22.089766  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

helpers_test.go:343: "busybox" [fb2236a7-f671-4e92-a1f5-91ee1f4ed836] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

E0915 19:22:23.764354  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:24.560327  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

helpers_test.go:343: "busybox" [fb2236a7-f671-4e92-a1f5-91ee1f4ed836] Running

E0915 19:22:28.769359  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:28.884635  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:29.680501  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:31.810665  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:32.329936  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

start_stop_delete_test.go:181: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 12.013001086s

start_stop_delete_test.go:181: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 exec busybox -- /bin/sh -c "ulimit -n"

--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (12.32s)

–

TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.8s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20210915191735-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:200: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 describe deploy/metrics-server -n kube-system

--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.80s)

–

TestStartStop/group/embed-certs/serial/Stop (11.21s)

=== RUN   TestStartStop/group/embed-certs/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-20210915191735-306161 --alsologtostderr -v=3

E0915 19:22:39.125179  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:39.921045  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-20210915191735-306161 --alsologtostderr -v=3: (11.208671653s)

--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.21s)

–

TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.2s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161: exit status 7 (98.991549ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20210915191735-306161 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.20s)

–

TestStartStop/group/embed-certs/serial/SecondStart (334.5s)

=== RUN   TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-20210915191735-306161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1

E0915 19:22:51.090733  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

E0915 19:22:52.810741  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:56.420174  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

E0915 19:22:59.606307  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:00.401785  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:07.860606  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:21.868477  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:33.771080  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/enable-default-cni-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:36.427805  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:40.567098  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kindnet-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:41.362481  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/kubenet-20210915191040-306161/client.crt: no such file or directory

E0915 19:23:50.689556  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

E0915 19:24:04.942914  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/addons-20210915184151-306161/client.crt: no such file or directory

E0915 19:24:18.340946  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/bridge-20210915191040-306161/client.crt: no such file or directory

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-20210915191735-306161 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.1: (5m34.023904266s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20210915191735-306161 -n embed-certs-20210915191735-306161

--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (334.50s)

–

TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (7.01s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-t4jvh" [0f379402-5a68-405a-9a86-33f2cb1d6e46] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-t4jvh" [0f379402-5a68-405a-9a86-33f2cb1d6e46] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 7.012016206s

--- PASS: TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (7.01s)

–

TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.09s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-t4jvh" [0f379402-5a68-405a-9a86-33f2cb1d6e46] Running

=== CONT  TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006303456s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context default-k8s-different-port-20210915191739-306161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/default-k8s-different-port/serial/AddonExistsAfterStop (5.09s)

–

TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (9.02s)

=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-xhsrl" [2f74e8ea-92e5-4e47-b2fc-034aa3634a84] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])

=== CONT  TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-xhsrl" [2f74e8ea-92e5-4e47-b2fc-034aa3634a84] Running

=== CONT  TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 9.014020718s

--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (9.02s)

–

TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.45s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p default-k8s-different-port-20210915191739-306161 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: busybox:1.28.4-glibc

--- PASS: TestStartStop/group/default-k8s-different-port/serial/VerifyKubernetesImages (0.45s)

–

TestStartStop/group/default-k8s-different-port/serial/Pause (3.55s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-different-port-20210915191739-306161 --alsologtostderr -v=1

=== CONT  TestStartStop/group/default-k8s-different-port/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161: exit status 2 (445.593125ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161: exit status 2 (506.307347ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-different-port-20210915191739-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-different-port-20210915191739-306161 -n default-k8s-different-port-20210915191739-306161

--- PASS: TestStartStop/group/default-k8s-different-port/serial/Pause (3.55s)

–

TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.1s)

=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-xhsrl" [2f74e8ea-92e5-4e47-b2fc-034aa3634a84] Running

=== CONT  TestStartStop/group/no-preload/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006330527s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context no-preload-20210915191727-306161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.10s)

–

TestStartStop/group/newest-cni/serial/FirstStart (36.92s)

=== RUN   TestStartStop/group/newest-cni/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20210915192447-306161 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0

E0915 19:24:47.968197  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/false-20210915191040-306161/client.crt: no such file or directory

=== CONT  TestStartStop/group/newest-cni/serial/FirstStart

start_stop_delete_test.go:171: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20210915192447-306161 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0: (36.919088904s)

--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (36.92s)

–

TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.44s)

=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-20210915191727-306161 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: busybox:1.28.4-glibc

--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.44s)

–

TestStartStop/group/no-preload/serial/Pause (3.42s)

=== RUN   TestStartStop/group/no-preload/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-20210915191727-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161: exit status 2 (437.966861ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161: exit status 2 (467.47793ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-20210915191727-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-20210915191727-306161 -n no-preload-20210915191727-306161

--- PASS: TestStartStop/group/no-preload/serial/Pause (3.42s)

–

TestStartStop/group/newest-cni/serial/DeployApp (0s)

=== RUN   TestStartStop/group/newest-cni/serial/DeployApp

--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

–

TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (5.61s)

=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive

start_stop_delete_test.go:190: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-20210915192447-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:190: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-20210915192447-306161 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (5.612964899s)

start_stop_delete_test.go:196: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (5.61s)

–

TestStartStop/group/newest-cni/serial/Stop (11.31s)

=== RUN   TestStartStop/group/newest-cni/serial/Stop

start_stop_delete_test.go:213: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-20210915192447-306161 --alsologtostderr -v=3

E0915 19:25:38.025075  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

start_stop_delete_test.go:213: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-20210915192447-306161 --alsologtostderr -v=3: (11.308281508s)

--- PASS: TestStartStop/group/newest-cni/serial/Stop (11.31s)

–

TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.2s)

=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop

start_stop_delete_test.go:224: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

start_stop_delete_test.go:224: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161: exit status 7 (96.332157ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:224: status error: exit status 7 (may be ok)

start_stop_delete_test.go:231: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-20210915192447-306161 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.20s)

–

TestStartStop/group/newest-cni/serial/SecondStart (21.59s)

=== RUN   TestStartStop/group/newest-cni/serial/SecondStart

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-20210915192447-306161 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0

E0915 19:25:51.701807  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/auto-20210915191040-306161/client.crt: no such file or directory

E0915 19:25:52.584065  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

E0915 19:25:54.140453  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/functional-20210915184623-306161/client.crt: no such file or directory

start_stop_delete_test.go:241: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-20210915192447-306161 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubelet.network-plugin=cni --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.22.2-rc.0: (21.156032043s)

start_stop_delete_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (21.59s)

–

TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop

start_stop_delete_test.go:258: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

–

TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop

start_stop_delete_test.go:269: WARNING: cni mode requires additional setup before pods can schedule :(

--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

–

TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.5s)

=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p newest-cni-20210915192447-306161 "sudo crictl images -o json"

--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.50s)

–

TestStartStop/group/newest-cni/serial/Pause (2.96s)

=== RUN   TestStartStop/group/newest-cni/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-20210915192447-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161: exit status 2 (389.788696ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161: exit status 2 (398.379082ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-20210915192447-306161 --alsologtostderr -v=1

E0915 19:26:05.709093  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/calico-20210915191040-306161/client.crt: no such file or directory

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-20210915192447-306161 -n newest-cni-20210915192447-306161

E0915 19:26:06.844385  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/custom-weave-20210915191040-306161/client.crt: no such file or directory

--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.96s)

–

TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.01s)

=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-5d8978d65d-z4b9r" [a4c9e781-165a-11ec-bbd7-02427fa71781] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.012390031s

--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.01s)

–

TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.26s)

=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-5d8978d65d-z4b9r" [a4c9e781-165a-11ec-bbd7-02427fa71781] Running

E0915 19:26:20.267998  306161 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-docker-docker-12425-302762-07c6aa0a52dfb95e89e99689c8f3f45bf5722157/.minikube/profiles/cilium-20210915191040-306161/client.crt: no such file or directory

start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.044395426s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context old-k8s-version-20210915191644-306161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.26s)

–

TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p old-k8s-version-20210915191644-306161 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: busybox:1.28.4-glibc

--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.38s)

–

TestStartStop/group/old-k8s-version/serial/Pause (3.06s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Pause

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-20210915191644-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161: exit status 2 (414.67016ms)

-- stdout --

	Paused

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

start_stop_delete_test.go:296: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161: exit status 2 (397.779647ms)

-- stdout --

	Stopped

-- /stdout --

start_stop_delete_test.go:296: status error: exit status 2 (may be ok)

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-20210915191644-306161 --alsologtostderr -v=1

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

start_stop_delete_test.go:296: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-20210915191644-306161 -n old-k8s-version-20210915191644-306161

--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.06s)

–

TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.07s)

=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop

start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-7b96n" [eb67847b-130f-44b3-814c-68d8291b6685] Running

start_stop_delete_test.go:259: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.068378137s

--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.07s)

–

TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.19s)

=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...

helpers_test.go:343: "kubernetes-dashboard-6fcdf4f6d-7b96n" [eb67847b-130f-44b3-814c-68d8291b6685] Running

start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.006284724s

start_stop_delete_test.go:276: (dbg) Run:  kubectl --context embed-certs-20210915191735-306161 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.19s)

–

TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.36s)

=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages

start_stop_delete_test.go:289: (dbg) Run:  out/minikube-linux-amd64 ssh -p embed-certs-20210915191735-306161 "sudo crictl images -o json"

start_stop_delete_test.go:289: Found non-minikube image: busybox:1.28.4-glibc

--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.36s)

Test skip (20/284)

Order	skiped test	Duration
5	TestDownloadOnly/v1.14.0/cached-images	0
6	TestDownloadOnly/v1.14.0/binaries	0
7	TestDownloadOnly/v1.14.0/kubectl	0
12	TestDownloadOnly/v1.22.1/cached-images	0
13	TestDownloadOnly/v1.22.1/binaries	0
14	TestDownloadOnly/v1.22.1/kubectl	0
19	TestDownloadOnly/v1.22.2-rc.0/cached-images	0
20	TestDownloadOnly/v1.22.2-rc.0/binaries	0
21	TestDownloadOnly/v1.22.2-rc.0/kubectl	0
43	TestHyperKitDriverInstallOrUpdate	0
44	TestHyperkitDriverSkipUpgrade	0
94	TestFunctional/parallel/PodmanEnv	0
117	TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig	0
118	TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil	0
119	TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS	0
129	TestGvisorAddon	0
177	TestChangeNoneUser	0
205	TestScheduledStopWindows	0
221	TestNetworkPlugins/group/flannel	0.3
241	TestStartStop/group/disable-driver-mounts	0.61

–

TestDownloadOnly/v1.14.0/cached-images (0s)

=== RUN   TestDownloadOnly/v1.14.0/cached-images

aaa_download_only_test.go:120: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.14.0/cached-images (0.00s)

–

TestDownloadOnly/v1.14.0/binaries (0s)

=== RUN   TestDownloadOnly/v1.14.0/binaries

aaa_download_only_test.go:139: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.14.0/binaries (0.00s)

–

TestDownloadOnly/v1.14.0/kubectl (0s)

=== RUN   TestDownloadOnly/v1.14.0/kubectl

aaa_download_only_test.go:155: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.14.0/kubectl (0.00s)

–

TestDownloadOnly/v1.22.1/cached-images (0s)

=== RUN   TestDownloadOnly/v1.22.1/cached-images

aaa_download_only_test.go:120: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.22.1/cached-images (0.00s)

–

TestDownloadOnly/v1.22.1/binaries (0s)

=== RUN   TestDownloadOnly/v1.22.1/binaries

aaa_download_only_test.go:139: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.22.1/binaries (0.00s)

–

TestDownloadOnly/v1.22.1/kubectl (0s)

=== RUN   TestDownloadOnly/v1.22.1/kubectl

aaa_download_only_test.go:155: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.22.1/kubectl (0.00s)

–

TestDownloadOnly/v1.22.2-rc.0/cached-images (0s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/cached-images

aaa_download_only_test.go:120: Preload exists, images won't be cached

--- SKIP: TestDownloadOnly/v1.22.2-rc.0/cached-images (0.00s)

–

TestDownloadOnly/v1.22.2-rc.0/binaries (0s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/binaries

aaa_download_only_test.go:139: Preload exists, binaries are present within.

--- SKIP: TestDownloadOnly/v1.22.2-rc.0/binaries (0.00s)

–

TestDownloadOnly/v1.22.2-rc.0/kubectl (0s)

=== RUN   TestDownloadOnly/v1.22.2-rc.0/kubectl

aaa_download_only_test.go:155: Test for darwin and windows

--- SKIP: TestDownloadOnly/v1.22.2-rc.0/kubectl (0.00s)

–

TestHyperKitDriverInstallOrUpdate (0s)

=== RUN   TestHyperKitDriverInstallOrUpdate

driver_install_or_update_test.go:115: Skip if not darwin.

--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

–

TestHyperkitDriverSkipUpgrade (0s)

=== RUN   TestHyperkitDriverSkipUpgrade

driver_install_or_update_test.go:188: Skip if not darwin.

--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

–

TestFunctional/parallel/PodmanEnv (0s)

=== RUN   TestFunctional/parallel/PodmanEnv

=== PAUSE TestFunctional/parallel/PodmanEnv

=== CONT  TestFunctional/parallel/PodmanEnv

functional_test.go:647: only validate podman env with docker container runtime, currently testing docker

--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig

functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil

functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

–

TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS

functional_test_tunnel_test.go:97: DNS forwarding is supported for darwin only now, skipping test DNS forwarding

--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

–

TestGvisorAddon (0s)

=== RUN   TestGvisorAddon

gvisor_addon_test.go:35: skipping test because --gvisor=false

--- SKIP: TestGvisorAddon (0.00s)

–

TestChangeNoneUser (0s)

=== RUN   TestChangeNoneUser

none_test.go:39: Only test none driver.

--- SKIP: TestChangeNoneUser (0.00s)

–

TestScheduledStopWindows (0s)

=== RUN   TestScheduledStopWindows

scheduled_stop_test.go:44: test only runs on windows

--- SKIP: TestScheduledStopWindows (0.00s)

–

TestNetworkPlugins/group/flannel (0.3s)

=== RUN   TestNetworkPlugins/group/flannel

=== CONT  TestNetworkPlugins/group/flannel

net_test.go:77: flannel is not yet compatible with Docker driver: iptables v1.8.3 (legacy): Couldn't load target `CNI-x': No such file or directory

helpers_test.go:176: Cleaning up "flannel-20210915191040-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p flannel-20210915191040-306161

--- SKIP: TestNetworkPlugins/group/flannel (0.30s)

–

TestStartStop/group/disable-driver-mounts (0.61s)

=== RUN   TestStartStop/group/disable-driver-mounts

=== PAUSE TestStartStop/group/disable-driver-mounts

=== CONT  TestStartStop/group/disable-driver-mounts

start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox

helpers_test.go:176: Cleaning up "disable-driver-mounts-20210915191738-306161" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-20210915191738-306161

--- SKIP: TestStartStop/group/disable-driver-mounts (0.61s)